-- Logs begin at Sat 2022-09-17 00:07:22 UTC, end at Sat 2022-09-17 01:04:27 UTC. -- Sep 17 00:34:06.581355 dv-cinder-857528-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 17 00:34:06.590296 dv-cinder-857528-4-smb devstack@keystone.service[87908]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 17 00:34:06 2022] *** Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: nodename: dv-cinder-857528-4-smb Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: machine: x86_64 Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: clock source: unix Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: pcre jit disabled Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: detected number of CPU cores: 4 Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: current working directory: / Sep 17 00:34:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87908]: detected binary path: /usr/bin/uwsgi-core Sep 17 00:34:06.592751 dv-cinder-857528-4-smb devstack@keystone.service[87908]: your processes number limit is 47680 Sep 17 00:34:06.592751 dv-cinder-857528-4-smb devstack@keystone.service[87908]: your memory page size is 4096 bytes Sep 17 00:34:06.592751 dv-cinder-857528-4-smb devstack@keystone.service[87908]: detected max file descriptor number: 2048 Sep 17 00:34:06.592751 dv-cinder-857528-4-smb devstack@keystone.service[87908]: lock engine: pthread robust mutexes Sep 17 00:34:06.592751 dv-cinder-857528-4-smb devstack@keystone.service[87908]: thunder lock: enabled Sep 17 00:34:06.592751 dv-cinder-857528-4-smb devstack@keystone.service[87908]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 17 00:34:06.592751 dv-cinder-857528-4-smb devstack@keystone.service[87908]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 17 00:34:06.632156 dv-cinder-857528-4-smb devstack@keystone.service[87908]: Python main interpreter initialized at 0x5599ffb439c0 Sep 17 00:34:06.632156 dv-cinder-857528-4-smb devstack@keystone.service[87908]: python threads support enabled Sep 17 00:34:06.632156 dv-cinder-857528-4-smb devstack@keystone.service[87908]: your server socket listen backlog is limited to 100 connections Sep 17 00:34:06.632156 dv-cinder-857528-4-smb devstack@keystone.service[87908]: your mercy for graceful operations on workers is 90 seconds Sep 17 00:34:06.632512 dv-cinder-857528-4-smb devstack@keystone.service[87908]: mapped 403077 bytes (393 KB) for 2 cores Sep 17 00:34:06.632592 dv-cinder-857528-4-smb devstack@keystone.service[87908]: *** Operational MODE: preforking *** Sep 17 00:34:06.632836 dv-cinder-857528-4-smb devstack@keystone.service[87908]: *** uWSGI is running in multiple interpreter mode *** Sep 17 00:34:06.632836 dv-cinder-857528-4-smb devstack@keystone.service[87908]: spawned uWSGI master process (pid: 87908) Sep 17 00:34:06.633035 dv-cinder-857528-4-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 17 00:34:06.633767 dv-cinder-857528-4-smb devstack@keystone.service[87908]: spawned uWSGI worker 1 (pid: 87919, cores: 1) Sep 17 00:34:06.637427 dv-cinder-857528-4-smb devstack@keystone.service[87908]: spawned uWSGI worker 2 (pid: 87920, cores: 1) Sep 17 00:34:06.637427 dv-cinder-857528-4-smb devstack@keystone.service[87908]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 17 00:34:10.908401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 00:34:10.908401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: from cryptography.utils import int_from_bytes Sep 17 00:34:10.909213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 00:34:10.909213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: from cryptography.utils import int_from_bytes Sep 17 00:34:10.910161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 00:34:10.910161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: from cryptography.utils import int_from_bytes Sep 17 00:34:10.910622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 17 00:34:10.910622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: from cryptography.utils import int_from_bytes Sep 17 00:34:10.958630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 00:34:10.958816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 00:34:10.959007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] command line args: [] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 00:34:10.959276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 00:34:10.959455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ================================================================================ {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 00:34:10.959709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] admin_token = **** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.959957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] config_dir = [] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.960045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 17 00:34:10.960151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.960237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 17 00:34:10.960335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] config_source = [] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.960419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] command line args: [] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 17 00:34:10.960518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] debug = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.960603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 17 00:34:10.960716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.960973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ================================================================================ {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 17 00:34:10.961044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] admin_token = **** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.961111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.961247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] config_dir = [] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.961325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.961451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.961538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.961647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] config_source = [] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.961758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.961837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] debug = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.961988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] list_limit = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.962066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.962155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] log_config_append = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.962228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.962360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.962442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.962508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] log_dir = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.962906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] log_file = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] list_limit = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] log_config_append = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.963981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] log_dir = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.964124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.964242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] log_file = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.964369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.964492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.964606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.964719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.964832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.964951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.965076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.965190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.965306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.965440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.965440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.965708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.965822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.965943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.966062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.966167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.966268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.966386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.966519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.966642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.966769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.966769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.966990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.967150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.967271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] publish_errors = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.967385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.967499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.967617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.967744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.967864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.967985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.968105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] publish_errors = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.968230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.968351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.968472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.968586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.968717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] standard_threads = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.968839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.968953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.969066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.969179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.969292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.969494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.969641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] standard_threads = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.969757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] use_journal = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.969757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] use_json = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.969979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.970101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] use_stderr = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.970267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.970386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] use_syslog = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.970499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.970648 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.971299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] use_journal = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.971299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] use_json = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.971527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.971643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] use_stderr = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.971763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.971884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] use_syslog = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.972005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.972125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 17 00:34:10.972253 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.972374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.972487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.972601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.972714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.972833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.972959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.973074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.973193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.973313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.973453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.973571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.973693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.973809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.973928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.974042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.974155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.974274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.974400 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.974522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.974636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.974749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.974862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.974982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.975112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.975235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.975355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.975470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.975583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.975696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.975820 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.975943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.976064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.976179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.976298 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.976413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.976604 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.976721 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.976835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.976955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.977070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.977195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.977322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.977461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.977579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.977693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.977806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.977958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.978076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.978189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.978302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.978414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.978527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.978648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.978769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.978889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.979004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.979116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.979236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.979359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.979473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.979622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.979744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.979858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.979977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.980101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.980215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.980329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.980441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.980553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.980665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.980785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.980906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.980906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.981134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.981247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.981359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.981359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.981359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.981726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.981840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.981952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.982064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.982254 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.982375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.982495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.982609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.982722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.982834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.982956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.983070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.983184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.983296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.983408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.983527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.983649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.983764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.983876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.983988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.984108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.984221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.984343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.984464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.984578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.984697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.984811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.984907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.985960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.986072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.986072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.986310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.986310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.986536 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.986651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.986765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.986887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.987007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.987007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.987235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.987351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.987473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.987473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.987677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.987799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.987915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.988019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.988131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.988131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.988345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.988478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.988603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.988719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.988846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.988966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.989081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.989204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.989317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.989483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.989603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.989717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.989832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.989958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.990070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.990185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.990299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.990413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.990527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.990650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.990767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.990882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.990996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.991116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.991233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.991355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.991472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.991587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.991701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.991816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.991930 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.992053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.992169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.992287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.992403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.992517 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.992631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.992754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.992870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.992985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.993108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.993225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.993345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.993557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.993679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.993794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.993909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.994023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.994147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.994272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.994396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.994513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.994634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.994751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.994873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.994989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.995112 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.995228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.995343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.995458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.995573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.995687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.995811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.995927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.996042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.996156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.996271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.996385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.996508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.996636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.996752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.996874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] auth.external = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.996990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.997131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.997258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.997382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.997553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.997671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.997795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] auth.external = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.997920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] auth.password = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.998038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.998153 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] auth.token = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.998276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.998394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.998516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.998633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.998748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] auth.password = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.998864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.998988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] auth.token = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.999112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.999229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.999345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.999466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.999583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.999707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.999824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:10.999939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.000055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] credential.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.000171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.000287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.000415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.000539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.000657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.000773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.000878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] credential.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.000990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.001115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.001232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.001349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.001489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.001614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.001731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.001864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.001982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.002105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.002223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.002341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.002457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.002580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.002698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.002814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.002929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.003044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.003160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.003284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.003401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.003516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.003631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.003747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.003871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] federation.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.003996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.004114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.004231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.004347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.004347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.004563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.004686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.004803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] federation.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.004919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.005034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.005150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.005274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.005391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.005561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.005678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.005794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.005909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.006036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.006156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.006272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.006395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.006512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.006629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.006752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.006870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.006985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.007100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.007216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.007332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.007525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.007644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.007760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.007876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.007991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.008106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.008229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.008347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.008463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.008579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.008694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.008810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.008933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.009050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.009165 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.009281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.009397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.009529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.009648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.009765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.009881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.009996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.010111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.010227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.010350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.010468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.010584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.010699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.010814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.010937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.011063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.011180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.011296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.011411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.011528 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.011643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.011767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.011885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.012000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.012115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.012230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.012349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.012473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.012591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.012706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.012821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.012943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.013060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.013183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.013300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.013461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.013579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.013695 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.013810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.013938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.014056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.014171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.014287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.014402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.014529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.014647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.014763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.014877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.014992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.015155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.015283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.015400 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.015515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.015629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.015745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.015859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.015982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.016099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.016242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.016359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.016465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.016579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.016579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.016805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.016920 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.016920 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.017136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.017282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.017918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.018032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.018148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.018261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.018410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.018529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.018656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.018775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.018893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.018893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.019111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.019226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.019349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.019475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.019591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.019707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.019822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.019928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.020050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.020168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.020283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.020398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.020513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.020628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.020751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.020868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.020983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.021099 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.021214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.021329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.021492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.021612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.021734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.021851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.021966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.022082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.022205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.022325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.022441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.022556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.022671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.022786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.022910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.023028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.023143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.023257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.023372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.023487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.023611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.023728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.023843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.023958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.024080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.024203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.024328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.024445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.024560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.024675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.024790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.024905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.025028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.025146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.025262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.025377 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.025506 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.025621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.025747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.025864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.025984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.026099 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.026214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.026327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.026327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.026556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.026670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.026784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.026897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.027011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.027133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.027250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.027364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.027478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.027591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.027705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.027827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.027942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.028056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] resource.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.028171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.028285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.028399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.028521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.028637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.028751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.028865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.028978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.029092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] resource.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.029214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.029332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.029486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.029602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.029716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.029830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.029957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.030074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.030188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.030302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.030416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] role.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.030609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.030728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] role.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.030843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.030956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.031070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.031184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.031306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.031423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.031538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] role.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.031652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.031765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] role.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.031879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.032002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.032118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.032217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.032336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.032451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.032567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.032690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.032807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.032922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.033038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.033741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.033861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.033991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.034110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.034226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.034342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.034457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.034574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.034698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.034698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.034916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.035032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.035148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.035263 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.035387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.035505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.035622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.035622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.035838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.035954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.036078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.036196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.036345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.036464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.036580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.036706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.036824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.036939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.037055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.037171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.037286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.037450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.037570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.037686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.037803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.037918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.038033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.038161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.038285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.038410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.038527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.038643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.038758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.038882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.038999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.039115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.039115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] token.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.039330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.039446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.039569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.039687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.039803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.039918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.040034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.040148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.040271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.040271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] token.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.040489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.040605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.040720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.040720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.040944 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.041062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.041177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.041292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.041421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.041598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.041715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.041833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.041951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.042067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.042182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.042302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.042426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.042544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.042660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.042776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.042900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.connection = **** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.043817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.044167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.044285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.044401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.044515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.connection = **** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.044630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.044745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.044869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.044986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.045103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.045219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.045335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.045490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.045621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.045741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.045857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.045973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.046089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.046206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.046330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.046448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.046564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.046679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.046795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.046911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.047980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87920) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 00:34:11.048197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.048197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.048197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.048197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 17 00:34:11.048197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87919) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 17 00:34:11.074230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.074458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.074681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.074935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.075168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.075392 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.083725 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.084161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.111987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.112213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.112408 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.112639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.165605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.168229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.215406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.215627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.217199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.217470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.370465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.370687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.370771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.370908 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.370990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.371127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.371209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.371345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.371425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.371554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.371641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.371761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.394849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.395080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.395310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.395538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.395755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.395968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.396180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.396924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.397159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.397386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.397633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.397851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.398062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.398272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.407339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.408976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.420559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.420772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.420885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.420985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.421066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.421214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.421329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.421455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.421558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.421677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.421759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.421902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87919) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.421993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.422099 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87920) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 17 00:34:11.439116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.439356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 00:34:11.439704 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.439788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.439905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 00:34:11.440004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 00:34:11.440181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.440313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.440441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.440523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 17 00:34:11.440701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.440782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.440960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.441039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.441254 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.441545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.450574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.450855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.451082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.451163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.451358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.451451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.451627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.451915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.458454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.458946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.461339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.461651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.461844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.461925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.462131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.462212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.462416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.462499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.462955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.463042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.463227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.463313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.463484 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.463562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.463753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.463831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.464026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.464105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.464290 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.464368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.464562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.464828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.487980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.488663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.489458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.489750 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.490142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.490426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.494408 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.494698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.494982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.495062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.495346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.495626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.501307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.501622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.501948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.502242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.507275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.507585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.507847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.507927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.508139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.508230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.508414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.508494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.508688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.508768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.508958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.509039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.509228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.509306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.509523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.509793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.525191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.525511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.525617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.525905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.529434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.529698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.532698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.532897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.533003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.533776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.537798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.537889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.540951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.541035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.544185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.544490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.544583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.544781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.544865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.545087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.545179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.545386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.545493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.545701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.545784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.545985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.561450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.561741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.562013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.562280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.562915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.563207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.563476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.563744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.569147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.570568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.570698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.572094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.572219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.572496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.573638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.573921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.575187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.575477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.575778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.576060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.576447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.576645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.576930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.577217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.577591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.577986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.588381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.588667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.588947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.589238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.589655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.589948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.590129 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.590233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.590416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.590697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.590976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.591350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.591636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.591914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.606179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.607682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.609077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.610592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.612094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.613494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.613644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.615021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.615105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.615365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.615761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.616472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.616752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.617140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.622113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.623569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.623806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.625256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.626455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.626880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.627170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.627450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.628170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.628565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.628847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.629118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.635237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.635533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.635816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.636854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.637144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.637441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.643198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87919) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.643483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.643763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.644039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.644323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.644595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.644808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87920) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 17 00:34:11.644899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.645091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.645173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.645368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.645475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.645664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.645754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.645945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.646026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.646208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.646288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.646474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.646553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.646755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.646833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87919) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.647023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.647303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.647574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.647833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.648095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.648410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87920) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 17 00:34:11.681210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5599ffb439c0 pid: 87919 (default app) Sep 17 00:34:11.682454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5599ffb439c0 pid: 87920 (default app) Sep 17 00:34:11.684492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262f480-602c-4b89-a5ba-655f8fffe88b None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:11.684782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262f480-602c-4b89-a5ba-655f8fffe88b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:11.685060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3262f480-602c-4b89-a5ba-655f8fffe88b None None] PATH_INFO: `/v3` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:11.689272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sat Sep 17 00:34:11 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:18.424049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4c55b-8c58-48d0-9d60-a3a82667a692 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:18.424467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4c55b-8c58-48d0-9d60-a3a82667a692 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:18.424629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f4c55b-8c58-48d0-9d60-a3a82667a692 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:18.429024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:18.434400 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:18.434835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:18.434970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:18.505185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: INFO dbcounter [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] Registered counter for database keystone Sep 17 00:34:18.524349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG oslo_db.sqlalchemy.engines [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87919) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 00:34:18.530518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writer thread running {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 00:34:18.713123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG passlib.handlers.bcrypt [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87919) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 00:34:18.713446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG passlib.handlers.bcrypt [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87919) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 00:34:18.771880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:18.773507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:18.901558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:18 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 468 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 17 00:34:19.192916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4c55b-8c58-48d0-9d60-a3a82667a692 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:19.263934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: INFO dbcounter [None req-c5f4c55b-8c58-48d0-9d60-a3a82667a692 None None] Registered counter for database keystone Sep 17 00:34:19.285142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG oslo_db.sqlalchemy.engines [None req-c5f4c55b-8c58-48d0-9d60-a3a82667a692 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87920) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 17 00:34:19.291376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writer thread running {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 17 00:34:19.416411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f4c55b-8c58-48d0-9d60-a3a82667a692 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:19.420795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f48e7-95ae-4150-8f8c-1a959577223e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:19.421454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f48e7-95ae-4150-8f8c-1a959577223e admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:19.421742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f48e7-95ae-4150-8f8c-1a959577223e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:19.422012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f48e7-95ae-4150-8f8c-1a959577223e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:19.431337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f48e7-95ae-4150-8f8c-1a959577223e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:19.482629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WARNING keystone.common.rbac_enforcer.enforcer [None req-776f48e7-95ae-4150-8f8c-1a959577223e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 00:34:19.482931 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f48e7-95ae-4150-8f8c-1a959577223e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:19.492964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Sep 17 00:34:19 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:34:19.498861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:19.515528 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f972c-404f-4cee-95ba-268304abb24d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:19.521720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11524a8c-0291-40d2-a87e-53854d7f2457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:19.522841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11524a8c-0291-40d2-a87e-53854d7f2457 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:19.523127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11524a8c-0291-40d2-a87e-53854d7f2457 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:19.523403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11524a8c-0291-40d2-a87e-53854d7f2457 admin admin] PATH_INFO: `/v3/projects/83b1863d33eb4870a81458f19dc5d56c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:19.524978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11524a8c-0291-40d2-a87e-53854d7f2457 admin admin] RBAC: Authorizing `identity:get_project(project_id=83b1863d33eb4870a81458f19dc5d56c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:19.576995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING keystone.common.rbac_enforcer.enforcer [None req-11524a8c-0291-40d2-a87e-53854d7f2457 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 17 00:34:19.577343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11524a8c-0291-40d2-a87e-53854d7f2457 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:19.581963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Sep 17 00:34:19 2022] GET /identity/v3/projects/83b1863d33eb4870a81458f19dc5d56c => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:21.689550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ec6b-c338-4648-bb57-0e2a0ff677f0 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:21.690046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ec6b-c338-4648-bb57-0e2a0ff677f0 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:21.690046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2ec6b-c338-4648-bb57-0e2a0ff677f0 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:21.694162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:21 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:21.699596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ced4f-3e12-445a-a3ca-12832dceebf1 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:21.699999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ced4f-3e12-445a-a3ca-12832dceebf1 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:21.700154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ced4f-3e12-445a-a3ca-12832dceebf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:21.720679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a74ced4f-3e12-445a-a3ca-12832dceebf1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:21.722237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a74ced4f-3e12-445a-a3ca-12832dceebf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:21.730015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 17 00:34:21.994552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ec6b-c338-4648-bb57-0e2a0ff677f0 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:22.006930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2ec6b-c338-4648-bb57-0e2a0ff677f0 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:22.011118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86020d16-ceab-4ded-aabb-e2aa234d9116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:22.011706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020d16-ceab-4ded-aabb-e2aa234d9116 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:22.011985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020d16-ceab-4ded-aabb-e2aa234d9116 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:22.012257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86020d16-ceab-4ded-aabb-e2aa234d9116 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:22.020321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86020d16-ceab-4ded-aabb-e2aa234d9116 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:22.022104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86020d16-ceab-4ded-aabb-e2aa234d9116 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:22.030601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Sep 17 00:34:21 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:34:22.035738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ced4f-3e12-445a-a3ca-12832dceebf1 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:22.044744 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74ced4f-3e12-445a-a3ca-12832dceebf1 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:22.049629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1debbcbc-a571-4248-8d09-575a29873ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:22.050251 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debbcbc-a571-4248-8d09-575a29873ea9 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:22.050535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debbcbc-a571-4248-8d09-575a29873ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:22.050813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1debbcbc-a571-4248-8d09-575a29873ea9 admin admin] PATH_INFO: `/v3/users/50b388ebd083407da9c5b53df1e1692d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:22.052114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debbcbc-a571-4248-8d09-575a29873ea9 admin admin] RBAC: Authorizing `identity:get_user(user_id=50b388ebd083407da9c5b53df1e1692d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:22.053986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1debbcbc-a571-4248-8d09-575a29873ea9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:22.055481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sat Sep 17 00:34:22 2022] GET /identity/v3/users/50b388ebd083407da9c5b53df1e1692d => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:24.253633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974fc8f-6df3-46b8-bd36-daf78d33207f None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.254171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974fc8f-6df3-46b8-bd36-daf78d33207f None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.254171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e974fc8f-6df3-46b8-bd36-daf78d33207f None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.255523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:24.257707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301cef-fdd4-47b1-b270-852ec94084d5 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.258096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301cef-fdd4-47b1-b270-852ec94084d5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.258384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b301cef-fdd4-47b1-b270-852ec94084d5 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.259861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:24.260343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fa84-487f-43f0-b833-0706014a0b29 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.260629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fa84-487f-43f0-b833-0706014a0b29 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.260905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12fa84-487f-43f0-b833-0706014a0b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.265215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b4a9-fe78-4f7f-830f-0a2a221f7d60 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.265533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b4a9-fe78-4f7f-830f-0a2a221f7d60 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.265817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc07b4a9-fe78-4f7f-830f-0a2a221f7d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.283794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-dc07b4a9-fe78-4f7f-830f-0a2a221f7d60 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:24.285034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-dc07b4a9-fe78-4f7f-830f-0a2a221f7d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:24.302094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG passlib.handlers.bcrypt [None req-2f12fa84-487f-43f0-b833-0706014a0b29 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87920) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 17 00:34:24.302491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG passlib.handlers.bcrypt [None req-2f12fa84-487f-43f0-b833-0706014a0b29 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87920) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 17 00:34:24.351406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2f12fa84-487f-43f0-b833-0706014a0b29 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:24.352956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2f12fa84-487f-43f0-b833-0706014a0b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:24.364958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 7/12] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:24.452092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 6/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:24.630787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b4a9-fe78-4f7f-830f-0a2a221f7d60 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.654209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.720007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12fa84-487f-43f0-b833-0706014a0b29 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.735807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc07b4a9-fe78-4f7f-830f-0a2a221f7d60 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.770144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeab02-5c9b-411b-9f71-df731923b800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeab02-5c9b-411b-9f71-df731923b800 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.771035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeab02-5c9b-411b-9f71-df731923b800 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.771310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abeab02-5c9b-411b-9f71-df731923b800 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.825033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12fa84-487f-43f0-b833-0706014a0b29 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:24.827619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.837515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeab02-5c9b-411b-9f71-df731923b800 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:24.839355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abeab02-5c9b-411b-9f71-df731923b800 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:24.861894 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:24.863718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f68f-b369-4156-8528-dbb59488acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:24.865028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f68f-b369-4156-8528-dbb59488acb1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:24.865313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f68f-b369-4156-8528-dbb59488acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:24.865615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8743f68f-b369-4156-8528-dbb59488acb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:24.877674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8743f68f-b369-4156-8528-dbb59488acb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-8743f68f-b369-4156-8528-dbb59488acb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:24.886325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:24.887208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:24.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:24.893820 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f68f-b369-4156-8528-dbb59488acb1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.936222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 8/15] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:24.942389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeab02-5c9b-411b-9f71-df731923b800 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:24.996219 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8743f68f-b369-4156-8528-dbb59488acb1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:25.029283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18da90-1c76-4f5f-b3cb-3d96c5889e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:25.029919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18da90-1c76-4f5f-b3cb-3d96c5889e61 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:25.030199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18da90-1c76-4f5f-b3cb-3d96c5889e61 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:25.030472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f18da90-1c76-4f5f-b3cb-3d96c5889e61 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:25.031137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18da90-1c76-4f5f-b3cb-3d96c5889e61 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:25.031450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18da90-1c76-4f5f-b3cb-3d96c5889e61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:25.033526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f18da90-1c76-4f5f-b3cb-3d96c5889e61 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:25.045002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 8/16] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:25.046989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abeab02-5c9b-411b-9f71-df731923b800 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:25.050595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18da90-1c76-4f5f-b3cb-3d96c5889e61 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:25.069148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:25.077353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:25.081994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d228e-8745-4ee1-8b79-17d03a71b9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:25.082624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d228e-8745-4ee1-8b79-17d03a71b9bb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:25.082918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d228e-8745-4ee1-8b79-17d03a71b9bb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:25.083174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0d228e-8745-4ee1-8b79-17d03a71b9bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:25.093113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d228e-8745-4ee1-8b79-17d03a71b9bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:25.094617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0d228e-8745-4ee1-8b79-17d03a71b9bb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-9b0d228e-8745-4ee1-8b79-17d03a71b9bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:34:25.112904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:25.113827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:34:25.114618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:34:25.114618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:34:25.114618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:25.114618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 9/17] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:25.119614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d228e-8745-4ee1-8b79-17d03a71b9bb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:25.149839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f18da90-1c76-4f5f-b3cb-3d96c5889e61 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:25.182717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e36b11-b89f-4ced-9b7a-5b9125622690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:25.183346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e36b11-b89f-4ced-9b7a-5b9125622690 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:25.183624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e36b11-b89f-4ced-9b7a-5b9125622690 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:25.183897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e36b11-b89f-4ced-9b7a-5b9125622690 None admin] PATH_INFO: `/v3/users/50b388ebd083407da9c5b53df1e1692d` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:25.185381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e36b11-b89f-4ced-9b7a-5b9125622690 None admin] RBAC: Authorizing `identity:get_user(user_id=50b388ebd083407da9c5b53df1e1692d)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:25.186841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e36b11-b89f-4ced-9b7a-5b9125622690 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:25.188393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 9/18] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:25 2022] GET /identity/v3/users/50b388ebd083407da9c5b53df1e1692d => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:25.194369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e36b11-b89f-4ced-9b7a-5b9125622690 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:25.217208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0d228e-8745-4ee1-8b79-17d03a71b9bb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:25.251064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1bad2-1b50-4985-a945-55eb75ea4f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:25.252238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1bad2-1b50-4985-a945-55eb75ea4f67 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:25.252521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1bad2-1b50-4985-a945-55eb75ea4f67 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:25.252793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d1bad2-1b50-4985-a945-55eb75ea4f67 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:25.253460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1bad2-1b50-4985-a945-55eb75ea4f67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:25.253762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1bad2-1b50-4985-a945-55eb75ea4f67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:25.255154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d1bad2-1b50-4985-a945-55eb75ea4f67 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:25.272813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 10/19] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:34:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:25.292425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:25.300815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e36b11-b89f-4ced-9b7a-5b9125622690 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:25.337167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df87dc72-860c-46d1-a562-460558043ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:25.338156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87dc72-860c-46d1-a562-460558043ec1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:25.338434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87dc72-860c-46d1-a562-460558043ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:25.338707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df87dc72-860c-46d1-a562-460558043ec1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:25.339848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87dc72-860c-46d1-a562-460558043ec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:25.341331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df87dc72-860c-46d1-a562-460558043ec1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:25.342976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 10/20] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:25.349010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1bad2-1b50-4985-a945-55eb75ea4f67 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:25.384522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:25.458211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d1bad2-1b50-4985-a945-55eb75ea4f67 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:25.491773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c77eb-bc0b-403d-87b4-d5e7e4a328c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:25.492383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c77eb-bc0b-403d-87b4-d5e7e4a328c2 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:25.492659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c77eb-bc0b-403d-87b4-d5e7e4a328c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:25.492930 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c77eb-bc0b-403d-87b4-d5e7e4a328c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:25.493691 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c77eb-bc0b-403d-87b4-d5e7e4a328c2 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.domain.id=default, user.id=50b388ebd083407da9c5b53df1e1692d) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:25.493992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c77eb-bc0b-403d-87b4-d5e7e4a328c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:25.495441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5c77eb-bc0b-403d-87b4-d5e7e4a328c2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:25.502655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 11/21] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Sep 17 00:34:25 2022] GET /identity/v3/role_assignments?user.id=50b388ebd083407da9c5b53df1e1692d&scope.domain.id=default&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:27.858379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45f80-be61-49f0-b2a0-f03d5073d889 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.859406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45f80-be61-49f0-b2a0-f03d5073d889 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.859891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf45f80-be61-49f0-b2a0-f03d5073d889 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.861576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 11/22] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:27.867264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b04037-f8dc-4eeb-8c69-9ab8843af166 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.868166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b04037-f8dc-4eeb-8c69-9ab8843af166 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.868665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b04037-f8dc-4eeb-8c69-9ab8843af166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.893565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f0b04037-f8dc-4eeb-8c69-9ab8843af166 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:27.894518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22722928-606f-4477-977d-a6a9029aa783 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.894821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f0b04037-f8dc-4eeb-8c69-9ab8843af166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:27.895307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22722928-606f-4477-977d-a6a9029aa783 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.895772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22722928-606f-4477-977d-a6a9029aa783 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.897974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 12/23] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:27.903357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5962853-2374-4261-b0b0-e64f2a3d872d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:27.903946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5962853-2374-4261-b0b0-e64f2a3d872d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:27.904976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5962853-2374-4261-b0b0-e64f2a3d872d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:27.936661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d5962853-2374-4261-b0b0-e64f2a3d872d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:27.938197 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d5962853-2374-4261-b0b0-e64f2a3d872d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:28.019666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 12/24] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:28.060783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 13/25] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:28.352056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe51f9-7e82-44f6-af04-d1e0f57dacf8 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.352762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe51f9-7e82-44f6-af04-d1e0f57dacf8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.353250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe51f9-7e82-44f6-af04-d1e0f57dacf8 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.354824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:28.360093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7afe4-e40c-47d4-9ee2-6e2da203680a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.360379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7afe4-e40c-47d4-9ee2-6e2da203680a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.360652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d7afe4-e40c-47d4-9ee2-6e2da203680a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.387244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-79d7afe4-e40c-47d4-9ee2-6e2da203680a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:28.388416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-79d7afe4-e40c-47d4-9ee2-6e2da203680a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:28.450763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed949c-aefd-405d-a5d7-d7928c750e84 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.451823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed949c-aefd-405d-a5d7-d7928c750e84 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.452300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ed949c-aefd-405d-a5d7-d7928c750e84 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.454878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 14/27] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:28.461814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3236a94-c5c1-426e-a764-2e3b7e05b4ed None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.462340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3236a94-c5c1-426e-a764-2e3b7e05b4ed None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.463072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3236a94-c5c1-426e-a764-2e3b7e05b4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.485529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a3236a94-c5c1-426e-a764-2e3b7e05b4ed None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:28.487077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a3236a94-c5c1-426e-a764-2e3b7e05b4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:28.490835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 14/28] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:28.505228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7afe4-e40c-47d4-9ee2-6e2da203680a None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.524170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:28.552313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:28.611832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 15/29] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:28.612686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3236a94-c5c1-426e-a764-2e3b7e05b4ed None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.727364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d7afe4-e40c-47d4-9ee2-6e2da203680a None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:28.791412 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3236a94-c5c1-426e-a764-2e3b7e05b4ed None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:28.804346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ddd5b-a028-4c9c-8c86-4ba871ac512b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:28.805283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ddd5b-a028-4c9c-8c86-4ba871ac512b None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.805722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ddd5b-a028-4c9c-8c86-4ba871ac512b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.806214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001ddd5b-a028-4c9c-8c86-4ba871ac512b None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.807610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ddd5b-a028-4c9c-8c86-4ba871ac512b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:28.809138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001ddd5b-a028-4c9c-8c86-4ba871ac512b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:28.866779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96913d68-b71d-4ff1-a711-4df592b79d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:28.867652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96913d68-b71d-4ff1-a711-4df592b79d58 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:28.868684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96913d68-b71d-4ff1-a711-4df592b79d58 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:28.869100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96913d68-b71d-4ff1-a711-4df592b79d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:28.888113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96913d68-b71d-4ff1-a711-4df592b79d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:28.893988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96913d68-b71d-4ff1-a711-4df592b79d58 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-96913d68-b71d-4ff1-a711-4df592b79d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:34:28.912821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:28.913921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:34:28.914888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:34:28.914888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:34:28.914888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:28.916310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 16/30] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:28.917353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96913d68-b71d-4ff1-a711-4df592b79d58 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:28.952934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:28.998562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 15/31] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 17 00:34:28 2022] POST /identity/v3/roles => generated 219 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:34:29.006522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ddd5b-a028-4c9c-8c86-4ba871ac512b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.027113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96913d68-b71d-4ff1-a711-4df592b79d58 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.066546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7b188-84f9-4e7d-880c-d5b95f1199b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.069445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7b188-84f9-4e7d-880c-d5b95f1199b6 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.069445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7b188-84f9-4e7d-880c-d5b95f1199b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.069445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead7b188-84f9-4e7d-880c-d5b95f1199b6 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.069445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7b188-84f9-4e7d-880c-d5b95f1199b6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.069909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead7b188-84f9-4e7d-880c-d5b95f1199b6 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.196405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:29.229435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001ddd5b-a028-4c9c-8c86-4ba871ac512b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.236591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 17/32] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 17 00:34:28 2022] POST /identity/v3/roles => generated 225 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:29.237668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7b188-84f9-4e7d-880c-d5b95f1199b6 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.327749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:29.339574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a55b8-e0f4-46f1-894a-84afb70894fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.340915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a55b8-e0f4-46f1-894a-84afb70894fb None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.341464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a55b8-e0f4-46f1-894a-84afb70894fb None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.341904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a55b8-e0f4-46f1-894a-84afb70894fb None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.342718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a55b8-e0f4-46f1-894a-84afb70894fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:29.343229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a55b8-e0f4-46f1-894a-84afb70894fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.344814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a55b8-e0f4-46f1-894a-84afb70894fb None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.371430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead7b188-84f9-4e7d-880c-d5b95f1199b6 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.387667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 16/33] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:34:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:29.393862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a55b8-e0f4-46f1-894a-84afb70894fb None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.409970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eb404-dd42-4e88-afeb-9ebdea2b334d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.410873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb404-dd42-4e88-afeb-9ebdea2b334d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.411311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb404-dd42-4e88-afeb-9ebdea2b334d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.411722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495eb404-dd42-4e88-afeb-9ebdea2b334d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.427322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495eb404-dd42-4e88-afeb-9ebdea2b334d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-495eb404-dd42-4e88-afeb-9ebdea2b334d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:29.434469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:29.435385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:29.436146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:29.439424 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 18/34] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:29.447169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eb404-dd42-4e88-afeb-9ebdea2b334d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.562068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495eb404-dd42-4e88-afeb-9ebdea2b334d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.579112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a55b8-e0f4-46f1-894a-84afb70894fb None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.600933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:29.607790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc910e7-ee75-4042-b288-432e1e5ae818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.608410 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc910e7-ee75-4042-b288-432e1e5ae818 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.608698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc910e7-ee75-4042-b288-432e1e5ae818 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.608981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc910e7-ee75-4042-b288-432e1e5ae818 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.609709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc910e7-ee75-4042-b288-432e1e5ae818 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:29.610001 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc910e7-ee75-4042-b288-432e1e5ae818 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.611582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc910e7-ee75-4042-b288-432e1e5ae818 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.620732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03ea1-fb57-4b43-8a32-2955853f2d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.621842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03ea1-fb57-4b43-8a32-2955853f2d76 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.622275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03ea1-fb57-4b43-8a32-2955853f2d76 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.622718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03ea1-fb57-4b43-8a32-2955853f2d76 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.623388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 19/35] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:29.623676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf03ea1-fb57-4b43-8a32-2955853f2d76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.624745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3988-8d3c-422b-9e23-9a70d3f04a21 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.625077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3988-8d3c-422b-9e23-9a70d3f04a21 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.625372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f3988-8d3c-422b-9e23-9a70d3f04a21 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.625723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf03ea1-fb57-4b43-8a32-2955853f2d76 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.627471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 20/36] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:29.630274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f3988-8d3c-422b-9e23-9a70d3f04a21 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.649229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:29.673440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 17/37] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:34:29 2022] POST /identity/v3/projects => generated 301 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:29.673440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d60d-1f07-44a3-a878-856c6073fd13 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.673440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d60d-1f07-44a3-a878-856c6073fd13 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.673440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc8d60d-1f07-44a3-a878-856c6073fd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.698971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7fc8d60d-1f07-44a3-a878-856c6073fd13 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:29.701190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7fc8d60d-1f07-44a3-a878-856c6073fd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:29.765282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f3988-8d3c-422b-9e23-9a70d3f04a21 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.807993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 18/38] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:29.809207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad88ae6-b1a2-492a-ada9-14c2d8424432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.809963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88ae6-b1a2-492a-ada9-14c2d8424432 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.810251 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88ae6-b1a2-492a-ada9-14c2d8424432 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.810576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad88ae6-b1a2-492a-ada9-14c2d8424432 None admin] PATH_INFO: `/v3/users/50b388ebd083407da9c5b53df1e1692d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.811980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad88ae6-b1a2-492a-ada9-14c2d8424432 None admin] RBAC: Authorizing `identity:get_user(user_id=50b388ebd083407da9c5b53df1e1692d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.813572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad88ae6-b1a2-492a-ada9-14c2d8424432 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.815722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 21/39] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:29 2022] GET /identity/v3/users/50b388ebd083407da9c5b53df1e1692d => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:29.821370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d60d-1f07-44a3-a878-856c6073fd13 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:29.849551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858b2f-5f70-4dbf-ad0a-8d7ac86dddd4 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.849864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858b2f-5f70-4dbf-ad0a-8d7ac86dddd4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.850113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64858b2f-5f70-4dbf-ad0a-8d7ac86dddd4 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.852878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 22/40] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:29.856663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e8e77-def2-4f80-9650-cfdd85d9e76f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.856946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e8e77-def2-4f80-9650-cfdd85d9e76f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.857223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e8e77-def2-4f80-9650-cfdd85d9e76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.946028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc8d60d-1f07-44a3-a878-856c6073fd13 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:29.978908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:29.987634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-5d1e8e77-def2-4f80-9650-cfdd85d9e76f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:29.988771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fe9e3-b9ae-4dea-b3b7-39a58962bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:29.989278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5d1e8e77-def2-4f80-9650-cfdd85d9e76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:29.989488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fe9e3-b9ae-4dea-b3b7-39a58962bd13 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:29.989723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fe9e3-b9ae-4dea-b3b7-39a58962bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:29.989999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409fe9e3-b9ae-4dea-b3b7-39a58962bd13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:29.991121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fe9e3-b9ae-4dea-b3b7-39a58962bd13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:29.992579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409fe9e3-b9ae-4dea-b3b7-39a58962bd13 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:29.994346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 19/41] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:29.999637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fe9e3-b9ae-4dea-b3b7-39a58962bd13 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:30.053772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:30.064932 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 23/42] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:30.087634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e8e77-def2-4f80-9650-cfdd85d9e76f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:30.108836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409fe9e3-b9ae-4dea-b3b7-39a58962bd13 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:30.147256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f597c-39ec-4c87-ac64-a44d27a32512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:30.147980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f597c-39ec-4c87-ac64-a44d27a32512 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:30.148269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f597c-39ec-4c87-ac64-a44d27a32512 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:30.148562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257f597c-39ec-4c87-ac64-a44d27a32512 None admin] PATH_INFO: `/v3/domains/default/users/50b388ebd083407da9c5b53df1e1692d/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:30.150944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f597c-39ec-4c87-ac64-a44d27a32512 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=50b388ebd083407da9c5b53df1e1692d, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:30.152693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257f597c-39ec-4c87-ac64-a44d27a32512 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:30.177432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 20/43] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Sep 17 00:34:29 2022] PUT /identity/v3/domains/default/users/50b388ebd083407da9c5b53df1e1692d/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:34:30.201675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1e8e77-def2-4f80-9650-cfdd85d9e76f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:30.241472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08d269-c8b9-4519-8e59-c15052c96ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:30.242044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d269-c8b9-4519-8e59-c15052c96ae2 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:30.242332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d269-c8b9-4519-8e59-c15052c96ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:30.242611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08d269-c8b9-4519-8e59-c15052c96ae2 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:30.243308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08d269-c8b9-4519-8e59-c15052c96ae2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:30.244761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08d269-c8b9-4519-8e59-c15052c96ae2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:30.261317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 24/44] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 17 00:34:30 2022] POST /identity/v3/roles => generated 223 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:34:30.335135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f597c-39ec-4c87-ac64-a44d27a32512 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:30.397980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:30.455549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257f597c-39ec-4c87-ac64-a44d27a32512 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:30.491838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55d086-bffd-4341-bf9a-39f4a92128dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:30.492406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55d086-bffd-4341-bf9a-39f4a92128dc None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:30.492725 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55d086-bffd-4341-bf9a-39f4a92128dc None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:30.493030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55d086-bffd-4341-bf9a-39f4a92128dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:30.494188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55d086-bffd-4341-bf9a-39f4a92128dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:30.495651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55d086-bffd-4341-bf9a-39f4a92128dc None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:30.497431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 21/45] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:30.503144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08d269-c8b9-4519-8e59-c15052c96ae2 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:30.555977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:30.609196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08d269-c8b9-4519-8e59-c15052c96ae2 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:30.642543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7b73a-f5a2-4e5c-bb53-66841f4ea928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:30.643163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b73a-f5a2-4e5c-bb53-66841f4ea928 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:30.643445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b73a-f5a2-4e5c-bb53-66841f4ea928 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:30.643720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7b73a-f5a2-4e5c-bb53-66841f4ea928 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:30.644387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7b73a-f5a2-4e5c-bb53-66841f4ea928 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:30.645882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7b73a-f5a2-4e5c-bb53-66841f4ea928 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:30.674618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 25/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:34:30 2022] POST /identity/v3/projects => generated 312 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:32.340761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef727a-8b03-42c5-ad56-1f685cfe9b09 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.341274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef727a-8b03-42c5-ad56-1f685cfe9b09 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.341381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef727a-8b03-42c5-ad56-1f685cfe9b09 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.342674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 22/47] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:32.347929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188066-44b4-4048-8252-4dfb9cf63b4a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.348318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188066-44b4-4048-8252-4dfb9cf63b4a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.348492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec188066-44b4-4048-8252-4dfb9cf63b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.368765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ec188066-44b4-4048-8252-4dfb9cf63b4a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:32.369978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ec188066-44b4-4048-8252-4dfb9cf63b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:32.444173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 26/48] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:32.716845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef727a-8b03-42c5-ad56-1f685cfe9b09 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:32.816015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0b82-ab2f-4f93-a6c3-46a0c0d0900b None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.816307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0b82-ab2f-4f93-a6c3-46a0c0d0900b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.816587 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40d0b82-ab2f-4f93-a6c3-46a0c0d0900b None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.817984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 27/49] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:32.819123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef727a-8b03-42c5-ad56-1f685cfe9b09 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:32.822980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c29b3a-ebe7-401e-b675-7f006aa5a3ef None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.823289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c29b3a-ebe7-401e-b675-7f006aa5a3ef None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.823566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c29b3a-ebe7-401e-b675-7f006aa5a3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.839799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:32.842126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f2c29b3a-ebe7-401e-b675-7f006aa5a3ef None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:32.843757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f2c29b3a-ebe7-401e-b675-7f006aa5a3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:32.853837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054be40c-fde7-4f2a-ad71-39e586f2f1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:32.854470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054be40c-fde7-4f2a-ad71-39e586f2f1f8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:32.854752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054be40c-fde7-4f2a-ad71-39e586f2f1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:32.855031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054be40c-fde7-4f2a-ad71-39e586f2f1f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:32.866727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054be40c-fde7-4f2a-ad71-39e586f2f1f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:32.870465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-054be40c-fde7-4f2a-ad71-39e586f2f1f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:32.871506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:32.872387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:32.873130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 23/50] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:32.880185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054be40c-fde7-4f2a-ad71-39e586f2f1f8 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:32.913550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 28/51] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:32.977626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054be40c-fde7-4f2a-ad71-39e586f2f1f8 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:33.016411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69bba0-b604-4e77-b25f-960b50b3fef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:33.017057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69bba0-b604-4e77-b25f-960b50b3fef0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:33.017339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69bba0-b604-4e77-b25f-960b50b3fef0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:33.017645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd69bba0-b604-4e77-b25f-960b50b3fef0 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:33.018320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69bba0-b604-4e77-b25f-960b50b3fef0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:33.018627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69bba0-b604-4e77-b25f-960b50b3fef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:33.019999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd69bba0-b604-4e77-b25f-960b50b3fef0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:33.028037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 24/52] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:33.034406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c29b3a-ebe7-401e-b675-7f006aa5a3ef None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:33.130551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c29b3a-ebe7-401e-b675-7f006aa5a3ef None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:33.164737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37149c-6837-4018-91cc-273f7b357ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:33.165363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37149c-6837-4018-91cc-273f7b357ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:33.165676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37149c-6837-4018-91cc-273f7b357ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:33.165956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e37149c-6837-4018-91cc-273f7b357ea9 None admin] PATH_INFO: `/v3/users/50b388ebd083407da9c5b53df1e1692d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:33.167064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37149c-6837-4018-91cc-273f7b357ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=50b388ebd083407da9c5b53df1e1692d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:33.168514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e37149c-6837-4018-91cc-273f7b357ea9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:33.170098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 29/53] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:33 2022] GET /identity/v3/users/50b388ebd083407da9c5b53df1e1692d => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:33.175503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69bba0-b604-4e77-b25f-960b50b3fef0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:33.205150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37149c-6837-4018-91cc-273f7b357ea9 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:33.217933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:33.236376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:33.274955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd69bba0-b604-4e77-b25f-960b50b3fef0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:33.303688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e37149c-6837-4018-91cc-273f7b357ea9 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:33.307709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516a37c-1c5d-44ac-aa02-48a71455f706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:33.308331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516a37c-1c5d-44ac-aa02-48a71455f706 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:33.308610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516a37c-1c5d-44ac-aa02-48a71455f706 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:33.308881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516a37c-1c5d-44ac-aa02-48a71455f706 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:33.309984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516a37c-1c5d-44ac-aa02-48a71455f706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:33.311423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516a37c-1c5d-44ac-aa02-48a71455f706 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:33.312980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 25/54] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:33.318737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516a37c-1c5d-44ac-aa02-48a71455f706 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:33.337369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4c047-0a39-4e5e-9b7f-551224b2482d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:33.338285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4c047-0a39-4e5e-9b7f-551224b2482d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:33.338568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4c047-0a39-4e5e-9b7f-551224b2482d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:33.338844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4c047-0a39-4e5e-9b7f-551224b2482d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:33.339961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4c047-0a39-4e5e-9b7f-551224b2482d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:33.341426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b4c047-0a39-4e5e-9b7f-551224b2482d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:33.342981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 30/55] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:33.348922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4c047-0a39-4e5e-9b7f-551224b2482d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:33.423122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516a37c-1c5d-44ac-aa02-48a71455f706 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:33.433731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:33.444459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:33.447682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4c047-0a39-4e5e-9b7f-551224b2482d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:33.457622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48339ac-5e4b-42d8-8480-1ad5345e0f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:33.458226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48339ac-5e4b-42d8-8480-1ad5345e0f7d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:33.458510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48339ac-5e4b-42d8-8480-1ad5345e0f7d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:33.458786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48339ac-5e4b-42d8-8480-1ad5345e0f7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:33.459513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48339ac-5e4b-42d8-8480-1ad5345e0f7d None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.domain.id=default, user.id=50b388ebd083407da9c5b53df1e1692d) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:33.459821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48339ac-5e4b-42d8-8480-1ad5345e0f7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:33.461272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48339ac-5e4b-42d8-8480-1ad5345e0f7d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:33.469489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 26/56] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Sep 17 00:34:33 2022] GET /identity/v3/role_assignments?user.id=50b388ebd083407da9c5b53df1e1692d&scope.domain.id=default&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:33.485440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276229e-f621-421e-bdbf-b3250af40616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:33.486620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276229e-f621-421e-bdbf-b3250af40616 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:33.486841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276229e-f621-421e-bdbf-b3250af40616 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:33.487211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276229e-f621-421e-bdbf-b3250af40616 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:33.487890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276229e-f621-421e-bdbf-b3250af40616 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:33.489373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276229e-f621-421e-bdbf-b3250af40616 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:33.518462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 31/57] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Sep 17 00:34:33 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:34:35.754284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522371d7-a234-4a9d-8a5a-f9b8b62d1256 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:35.754793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522371d7-a234-4a9d-8a5a-f9b8b62d1256 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:35.754881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522371d7-a234-4a9d-8a5a-f9b8b62d1256 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:35.756166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 27/58] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:35.761431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdc28-42e1-4860-b163-e49f2986f3af None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:35.761825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdc28-42e1-4860-b163-e49f2986f3af None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:35.761986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ecdc28-42e1-4860-b163-e49f2986f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:35.780741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b6ecdc28-42e1-4860-b163-e49f2986f3af None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:35.781975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b6ecdc28-42e1-4860-b163-e49f2986f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:35.846127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 32/59] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:36.114896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522371d7-a234-4a9d-8a5a-f9b8b62d1256 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:36.211226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522371d7-a234-4a9d-8a5a-f9b8b62d1256 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:36.243459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033dda3-c763-4feb-a07c-ea8659466ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:36.244073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033dda3-c763-4feb-a07c-ea8659466ed5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:36.244351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033dda3-c763-4feb-a07c-ea8659466ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:36.244622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033dda3-c763-4feb-a07c-ea8659466ed5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:36.245748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033dda3-c763-4feb-a07c-ea8659466ed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:36.247186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033dda3-c763-4feb-a07c-ea8659466ed5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:36.248699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 28/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:36.253983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdc28-42e1-4860-b163-e49f2986f3af None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:36.330011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:36.349386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ecdc28-42e1-4860-b163-e49f2986f3af None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:36.383178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baec936-4fce-4757-9fb3-a4317c8fc906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:36.383700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec936-4fce-4757-9fb3-a4317c8fc906 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:36.383979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec936-4fce-4757-9fb3-a4317c8fc906 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:36.384258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baec936-4fce-4757-9fb3-a4317c8fc906 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:36.384901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baec936-4fce-4757-9fb3-a4317c8fc906 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:36.386364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baec936-4fce-4757-9fb3-a4317c8fc906 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:36.411939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 33/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:34:36 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:39.740705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abf17-9ac2-493d-a890-28bcc63a4d1d None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.741708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abf17-9ac2-493d-a890-28bcc63a4d1d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.742203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522abf17-9ac2-493d-a890-28bcc63a4d1d None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.743764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 29/62] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:39.749549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0dcc7-bc85-446b-97b2-840491fcfb7e None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.750061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0dcc7-bc85-446b-97b2-840491fcfb7e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.750533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa0dcc7-bc85-446b-97b2-840491fcfb7e None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.753781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace964-36cd-4802-896a-c0f0b2046063 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.754599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace964-36cd-4802-896a-c0f0b2046063 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.755075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bace964-36cd-4802-896a-c0f0b2046063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.755596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 30/63] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:39.759854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdbbab-d12a-4d8a-8f16-cbb25de3a005 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.760391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdbbab-d12a-4d8a-8f16-cbb25de3a005 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.760874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdbbab-d12a-4d8a-8f16-cbb25de3a005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:39.789554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8bace964-36cd-4802-896a-c0f0b2046063 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:39.792211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8bace964-36cd-4802-896a-c0f0b2046063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:39.796516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f4cdbbab-d12a-4d8a-8f16-cbb25de3a005 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:39.799850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f4cdbbab-d12a-4d8a-8f16-cbb25de3a005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:39.847196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:39.889647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 31/64] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:39.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 34/65] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:39.998235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782c11d-bb60-4c6f-b8e2-504e0755f793 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:39.998845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782c11d-bb60-4c6f-b8e2-504e0755f793 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:39.999322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782c11d-bb60-4c6f-b8e2-504e0755f793 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.000953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 32/66] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:40.007504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f99bd-f3df-476f-a3be-f60f2b83fdab None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.007796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f99bd-f3df-476f-a3be-f60f2b83fdab None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.008230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f99bd-f3df-476f-a3be-f60f2b83fdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.034389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a86f99bd-f3df-476f-a3be-f60f2b83fdab None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:40.035825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a86f99bd-f3df-476f-a3be-f60f2b83fdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:40.096395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8204b5-254c-484f-94cc-fc8731281605 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.097036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8204b5-254c-484f-94cc-fc8731281605 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.097554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8204b5-254c-484f-94cc-fc8731281605 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.099105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 33/67] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:40.104501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a9f3f-1024-45e3-bd33-af1c7512f2cf None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.104994 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a9f3f-1024-45e3-bd33-af1c7512f2cf None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.105496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7a9f3f-1024-45e3-bd33-af1c7512f2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.134836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.144393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 35/68] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:40.223260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f99bd-f3df-476f-a3be-f60f2b83fdab None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.248854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ef7a9f3f-1024-45e3-bd33-af1c7512f2cf None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:40.250432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ef7a9f3f-1024-45e3-bd33-af1c7512f2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:40.327256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 34/69] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:40.328690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a9f3f-1024-45e3-bd33-af1c7512f2cf None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.354112 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f99bd-f3df-476f-a3be-f60f2b83fdab None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.422581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b949f27-ac7a-434e-868e-b8cab5fda180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.423664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b949f27-ac7a-434e-868e-b8cab5fda180 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.429589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b949f27-ac7a-434e-868e-b8cab5fda180 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.431167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b949f27-ac7a-434e-868e-b8cab5fda180 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.460462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b949f27-ac7a-434e-868e-b8cab5fda180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-9b949f27-ac7a-434e-868e-b8cab5fda180 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:40.465913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:40.466922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:40.467806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:40.471095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 36/70] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:40.476119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b949f27-ac7a-434e-868e-b8cab5fda180 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.496850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7a9f3f-1024-45e3-bd33-af1c7512f2cf None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.498352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.534798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4813b-ab5a-46dc-9161-5a85d3888aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.535280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4813b-ab5a-46dc-9161-5a85d3888aae None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.535558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4813b-ab5a-46dc-9161-5a85d3888aae None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.535833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4813b-ab5a-46dc-9161-5a85d3888aae None admin] PATH_INFO: `/v3/roles/member` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.546173 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4813b-ab5a-46dc-9161-5a85d3888aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:40.549306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-ecf4813b-ab5a-46dc-9161-5a85d3888aae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:40.551610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:40.552488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:40.553226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:40.554605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4813b-ab5a-46dc-9161-5a85d3888aae None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.605693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b949f27-ac7a-434e-868e-b8cab5fda180 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.647167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c34869-17c6-47b6-9c02-ce86e1e91946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.647777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c34869-17c6-47b6-9c02-ce86e1e91946 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.648057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c34869-17c6-47b6-9c02-ce86e1e91946 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.648329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c34869-17c6-47b6-9c02-ce86e1e91946 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.648994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c34869-17c6-47b6-9c02-ce86e1e91946 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:40.649295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c34869-17c6-47b6-9c02-ce86e1e91946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.650723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c34869-17c6-47b6-9c02-ce86e1e91946 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.652771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4813b-ab5a-46dc-9161-5a85d3888aae None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.659185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 37/72] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:40.660334 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c44bd7-7be0-4b8f-bcf3-169f1d4df1cc None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.660622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c44bd7-7be0-4b8f-bcf3-169f1d4df1cc None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.660899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c44bd7-7be0-4b8f-bcf3-169f1d4df1cc None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.662283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 38/73] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:40.662798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c44bd7-7be0-4b8f-bcf3-169f1d4df1cc None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.688562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d6c87-857c-4afc-9304-377d033f2f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.689196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d6c87-857c-4afc-9304-377d033f2f1d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.689507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d6c87-857c-4afc-9304-377d033f2f1d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.689791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397d6c87-857c-4afc-9304-377d033f2f1d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.699729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397d6c87-857c-4afc-9304-377d033f2f1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-397d6c87-857c-4afc-9304-377d033f2f1d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:40.704527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:40.705558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 36/74] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:40.710398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d6c87-857c-4afc-9304-377d033f2f1d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.732834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.771372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c44bd7-7be0-4b8f-bcf3-169f1d4df1cc None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.787766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:40.804880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b81499-d5b8-4e75-924b-d22e1a0038e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.805519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b81499-d5b8-4e75-924b-d22e1a0038e5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.805807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b81499-d5b8-4e75-924b-d22e1a0038e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.806109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b81499-d5b8-4e75-924b-d22e1a0038e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.806773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b81499-d5b8-4e75-924b-d22e1a0038e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:40.807079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b81499-d5b8-4e75-924b-d22e1a0038e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.807913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397d6c87-857c-4afc-9304-377d033f2f1d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.808478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b81499-d5b8-4e75-924b-d22e1a0038e5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.817304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 39/75] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:40.818201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b81499-d5b8-4e75-924b-d22e1a0038e5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.842298 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c34480-4c2f-4710-bec4-a89056e3687a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.842928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c34480-4c2f-4710-bec4-a89056e3687a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.843211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c34480-4c2f-4710-bec4-a89056e3687a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.843488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c34480-4c2f-4710-bec4-a89056e3687a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.853391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c34480-4c2f-4710-bec4-a89056e3687a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-49c34480-4c2f-4710-bec4-a89056e3687a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:40.858243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:40.859069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:40.859799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 37/76] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:40.861001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2128aad-cf0e-4a65-894b-5ba78bc337c0 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.861286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2128aad-cf0e-4a65-894b-5ba78bc337c0 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.861599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2128aad-cf0e-4a65-894b-5ba78bc337c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.878559 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a2128aad-cf0e-4a65-894b-5ba78bc337c0 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:40.879773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a2128aad-cf0e-4a65-894b-5ba78bc337c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:40.920653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b81499-d5b8-4e75-924b-d22e1a0038e5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:40.953136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 38/77] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:40.953463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8f17b-bdd1-468a-9742-febfbdc64adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:40.954093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8f17b-bdd1-468a-9742-febfbdc64adf None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:40.954880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8f17b-bdd1-468a-9742-febfbdc64adf None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:40.955183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f8f17b-bdd1-468a-9742-febfbdc64adf None admin] PATH_INFO: `/v3/users/50b388ebd083407da9c5b53df1e1692d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:40.956333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8f17b-bdd1-468a-9742-febfbdc64adf None admin] RBAC: Authorizing `identity:get_user(user_id=50b388ebd083407da9c5b53df1e1692d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:40.957824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f8f17b-bdd1-468a-9742-febfbdc64adf None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:40.959406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 40/78] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/users/50b388ebd083407da9c5b53df1e1692d => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:40.960165 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8f17b-bdd1-468a-9742-febfbdc64adf None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.962464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2128aad-cf0e-4a65-894b-5ba78bc337c0 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:40.978483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.013731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.065191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f8f17b-bdd1-468a-9742-febfbdc64adf None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.076919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2128aad-cf0e-4a65-894b-5ba78bc337c0 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.101132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fd441-eea4-4319-8fd2-79a442b62b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.101809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fd441-eea4-4319-8fd2-79a442b62b98 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.102090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fd441-eea4-4319-8fd2-79a442b62b98 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.102364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fd441-eea4-4319-8fd2-79a442b62b98 None admin] PATH_INFO: `/v3/users/62419e76eac94a61b44066fc9bade636` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.115519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62d77c-fb3b-48e6-a1c9-05d816d012c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.115815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fd441-eea4-4319-8fd2-79a442b62b98 None admin] RBAC: Authorizing `identity:get_user(user_id=62419e76eac94a61b44066fc9bade636)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.116132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d77c-fb3b-48e6-a1c9-05d816d012c5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.116448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d77c-fb3b-48e6-a1c9-05d816d012c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.116729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62d77c-fb3b-48e6-a1c9-05d816d012c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.117269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fd441-eea4-4319-8fd2-79a442b62b98 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.117451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62d77c-fb3b-48e6-a1c9-05d816d012c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:41.117752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62d77c-fb3b-48e6-a1c9-05d816d012c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.123481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 41/79] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/users/62419e76eac94a61b44066fc9bade636 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.123622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62d77c-fb3b-48e6-a1c9-05d816d012c5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.123707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fd441-eea4-4319-8fd2-79a442b62b98 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.132120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 39/80] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:34:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.132743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62d77c-fb3b-48e6-a1c9-05d816d012c5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.213109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.230453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fd441-eea4-4319-8fd2-79a442b62b98 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.238199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.240900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62d77c-fb3b-48e6-a1c9-05d816d012c5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.264972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9d6bf-e7e2-4d13-a1d2-76dcd151fad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.265633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9d6bf-e7e2-4d13-a1d2-76dcd151fad7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.265919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9d6bf-e7e2-4d13-a1d2-76dcd151fad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.266193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c9d6bf-e7e2-4d13-a1d2-76dcd151fad7 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.266893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9d6bf-e7e2-4d13-a1d2-76dcd151fad7 None admin] RBAC: Adding query filter params (name=member) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:41.267201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9d6bf-e7e2-4d13-a1d2-76dcd151fad7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.268591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c9d6bf-e7e2-4d13-a1d2-76dcd151fad7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.273985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb110-6887-4b2a-a4f5-8e3b4aa8ff4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.274593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb110-6887-4b2a-a4f5-8e3b4aa8ff4a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.274878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb110-6887-4b2a-a4f5-8e3b4aa8ff4a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.275155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4eb110-6887-4b2a-a4f5-8e3b4aa8ff4a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.276322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 42/81] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.278294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9d6bf-e7e2-4d13-a1d2-76dcd151fad7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.342688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb110-6887-4b2a-a4f5-8e3b4aa8ff4a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.344085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4eb110-6887-4b2a-a4f5-8e3b4aa8ff4a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.375794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c9d6bf-e7e2-4d13-a1d2-76dcd151fad7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.409636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12035-78e2-4379-96d4-ced03a1060cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.410936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12035-78e2-4379-96d4-ced03a1060cb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.411220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12035-78e2-4379-96d4-ced03a1060cb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.411499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d12035-78e2-4379-96d4-ced03a1060cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.415327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.444967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 40/82] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:41.445842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb110-6887-4b2a-a4f5-8e3b4aa8ff4a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.446563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.480441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12035-78e2-4379-96d4-ced03a1060cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.481973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d12035-78e2-4379-96d4-ced03a1060cb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.543649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4eb110-6887-4b2a-a4f5-8e3b4aa8ff4a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.576177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae95668-5f06-40ca-9df8-2ca8f3e1e7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.576797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae95668-5f06-40ca-9df8-2ca8f3e1e7f9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.577075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae95668-5f06-40ca-9df8-2ca8f3e1e7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.577348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae95668-5f06-40ca-9df8-2ca8f3e1e7f9 None admin] PATH_INFO: `/v3/users/62419e76eac94a61b44066fc9bade636` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.577795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 43/83] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:41.578620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12035-78e2-4379-96d4-ced03a1060cb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.582117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae95668-5f06-40ca-9df8-2ca8f3e1e7f9 None admin] RBAC: Authorizing `identity:get_user(user_id=62419e76eac94a61b44066fc9bade636)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.583616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae95668-5f06-40ca-9df8-2ca8f3e1e7f9 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.585194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 41/84] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/users/62419e76eac94a61b44066fc9bade636 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.585983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae95668-5f06-40ca-9df8-2ca8f3e1e7f9 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.628012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.647419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.679965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d12035-78e2-4379-96d4-ced03a1060cb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.684445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae95668-5f06-40ca-9df8-2ca8f3e1e7f9 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.713314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a84d-e002-4b76-bddf-1f326a283ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.713975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a84d-e002-4b76-bddf-1f326a283ee8 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.714261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a84d-e002-4b76-bddf-1f326a283ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.714533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0a84d-e002-4b76-bddf-1f326a283ee8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.715643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a84d-e002-4b76-bddf-1f326a283ee8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.717100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0a84d-e002-4b76-bddf-1f326a283ee8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.718680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 44/85] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.719432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a84d-e002-4b76-bddf-1f326a283ee8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.719614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9d61-d172-4d32-b60a-d7f0e3bbd925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.720389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9d61-d172-4d32-b60a-d7f0e3bbd925 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.720677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9d61-d172-4d32-b60a-d7f0e3bbd925 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.720955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1f9d61-d172-4d32-b60a-d7f0e3bbd925 None admin] PATH_INFO: `/v3/users/62419e76eac94a61b44066fc9bade636` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.722302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9d61-d172-4d32-b60a-d7f0e3bbd925 None admin] RBAC: Authorizing `identity:get_user(user_id=62419e76eac94a61b44066fc9bade636)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.724721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1f9d61-d172-4d32-b60a-d7f0e3bbd925 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.726373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 42/86] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/users/62419e76eac94a61b44066fc9bade636 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.728356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9d61-d172-4d32-b60a-d7f0e3bbd925 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.822899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0a84d-e002-4b76-bddf-1f326a283ee8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.830482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1f9d61-d172-4d32-b60a-d7f0e3bbd925 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.840881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.855827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b33b3-5f40-4885-94b8-f27389f29378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.856462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b33b3-5f40-4885-94b8-f27389f29378 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.856744 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b33b3-5f40-4885-94b8-f27389f29378 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.857020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b33b3-5f40-4885-94b8-f27389f29378 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.858167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b33b3-5f40-4885-94b8-f27389f29378 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.859624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b33b3-5f40-4885-94b8-f27389f29378 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.862074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 45/87] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.862735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b33b3-5f40-4885-94b8-f27389f29378 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.864831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb79e5-494f-421d-ba2c-24ca2d33ebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.865505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb79e5-494f-421d-ba2c-24ca2d33ebcd None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.865800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb79e5-494f-421d-ba2c-24ca2d33ebcd None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.866086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fb79e5-494f-421d-ba2c-24ca2d33ebcd None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:41.867054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:41.867478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb79e5-494f-421d-ba2c-24ca2d33ebcd None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:41.868944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fb79e5-494f-421d-ba2c-24ca2d33ebcd None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:41.875217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 43/88] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:41.875217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb79e5-494f-421d-ba2c-24ca2d33ebcd None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:41.960382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b33b3-5f40-4885-94b8-f27389f29378 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.971672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fb79e5-494f-421d-ba2c-24ca2d33ebcd None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:41.994496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee41b4e-12eb-41cc-b507-e0a047800f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:41.995100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee41b4e-12eb-41cc-b507-e0a047800f7a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:41.995376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee41b4e-12eb-41cc-b507-e0a047800f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:41.995648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee41b4e-12eb-41cc-b507-e0a047800f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.005789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966d2e-66df-4ca9-9478-a7cf1a32d297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.006402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966d2e-66df-4ca9-9478-a7cf1a32d297 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.006685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966d2e-66df-4ca9-9478-a7cf1a32d297 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.006963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f966d2e-66df-4ca9-9478-a7cf1a32d297 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.007623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f966d2e-66df-4ca9-9478-a7cf1a32d297 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.009093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f966d2e-66df-4ca9-9478-a7cf1a32d297 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.043444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 44/89] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:34:41 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:42.044299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966d2e-66df-4ca9-9478-a7cf1a32d297 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.078208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee41b4e-12eb-41cc-b507-e0a047800f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.079900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee41b4e-12eb-41cc-b507-e0a047800f7a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.084513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.102311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.184203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f966d2e-66df-4ca9-9478-a7cf1a32d297 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.196206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 46/90] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:42.201222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee41b4e-12eb-41cc-b507-e0a047800f7a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.228421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669135b2-871a-4766-ad80-1c538f732c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.229056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669135b2-871a-4766-ad80-1c538f732c8c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.229346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669135b2-871a-4766-ad80-1c538f732c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.229652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669135b2-871a-4766-ad80-1c538f732c8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.311319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee41b4e-12eb-41cc-b507-e0a047800f7a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.315291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.315529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669135b2-871a-4766-ad80-1c538f732c8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.317044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669135b2-871a-4766-ad80-1c538f732c8c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.355538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5719d2c-6e63-4967-8b0a-b85dbbcd5bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.356398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5719d2c-6e63-4967-8b0a-b85dbbcd5bbb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.356831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5719d2c-6e63-4967-8b0a-b85dbbcd5bbb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.357111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5719d2c-6e63-4967-8b0a-b85dbbcd5bbb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.357935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5719d2c-6e63-4967-8b0a-b85dbbcd5bbb None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c, user.id=50b388ebd083407da9c5b53df1e1692d) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:42.358249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5719d2c-6e63-4967-8b0a-b85dbbcd5bbb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.359716 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5719d2c-6e63-4967-8b0a-b85dbbcd5bbb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.361038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.367209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 47/91] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/role_assignments?user.id=50b388ebd083407da9c5b53df1e1692d&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:42.367942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5719d2c-6e63-4967-8b0a-b85dbbcd5bbb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.458997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 45/92] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:42.463110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669135b2-871a-4766-ad80-1c538f732c8c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.530224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5719d2c-6e63-4967-8b0a-b85dbbcd5bbb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.567609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3ec64-d059-4f3d-952a-39f5b85f77f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.568276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3ec64-d059-4f3d-952a-39f5b85f77f7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.568562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3ec64-d059-4f3d-952a-39f5b85f77f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.568840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f3ec64-d059-4f3d-952a-39f5b85f77f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.569623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3ec64-d059-4f3d-952a-39f5b85f77f7 None admin] RBAC: Adding query filter params (role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c, user.id=62419e76eac94a61b44066fc9bade636) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:42.569937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3ec64-d059-4f3d-952a-39f5b85f77f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.571897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f3ec64-d059-4f3d-952a-39f5b85f77f7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.578328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 48/93] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/role_assignments?user.id=62419e76eac94a61b44066fc9bade636&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=165f39c0a24042fdacc0121c96347bcd => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:42.579725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3ec64-d059-4f3d-952a-39f5b85f77f7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.607337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669135b2-871a-4766-ad80-1c538f732c8c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.638359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.658620 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b15b-e8c0-4332-b1fc-bf76738aa616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.660022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b15b-e8c0-4332-b1fc-bf76738aa616 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.660516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b15b-e8c0-4332-b1fc-bf76738aa616 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.661257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e4b15b-e8c0-4332-b1fc-bf76738aa616 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.663263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4b15b-e8c0-4332-b1fc-bf76738aa616 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.664983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e4b15b-e8c0-4332-b1fc-bf76738aa616 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.667764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 46/94] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:42.674930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b15b-e8c0-4332-b1fc-bf76738aa616 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.679863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:42.737921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f3ec64-d059-4f3d-952a-39f5b85f77f7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.801440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cdd7f-ca30-477b-9fbf-ac4e0531868a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.802001 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cdd7f-ca30-477b-9fbf-ac4e0531868a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.802280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cdd7f-ca30-477b-9fbf-ac4e0531868a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.802560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197cdd7f-ca30-477b-9fbf-ac4e0531868a None admin] PATH_INFO: `/v3/projects/0724cd133fb748b58b6389d4ddb3478a` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.803881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cdd7f-ca30-477b-9fbf-ac4e0531868a None admin] RBAC: Authorizing `identity:get_project(project_id=0724cd133fb748b58b6389d4ddb3478a)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.805665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197cdd7f-ca30-477b-9fbf-ac4e0531868a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.807478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 49/95] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/projects/0724cd133fb748b58b6389d4ddb3478a => generated 312 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:42.814468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cdd7f-ca30-477b-9fbf-ac4e0531868a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:42.864033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e4b15b-e8c0-4332-b1fc-bf76738aa616 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:42.930525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351e376-a018-40c7-bd15-c8f4244ec214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:42.931203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351e376-a018-40c7-bd15-c8f4244ec214 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:42.931491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351e376-a018-40c7-bd15-c8f4244ec214 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:42.931772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351e376-a018-40c7-bd15-c8f4244ec214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:42.932520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351e376-a018-40c7-bd15-c8f4244ec214 None admin] RBAC: Adding query filter params (role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c, user.id=62419e76eac94a61b44066fc9bade636) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:42.932831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351e376-a018-40c7-bd15-c8f4244ec214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:42.934328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351e376-a018-40c7-bd15-c8f4244ec214 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:42.943266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 47/96] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/role_assignments?user.id=62419e76eac94a61b44066fc9bade636&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:42.999201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197cdd7f-ca30-477b-9fbf-ac4e0531868a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:43.001723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:43.053093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73130a58-f846-4dff-bfff-0c46ad057348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:43.053657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130a58-f846-4dff-bfff-0c46ad057348 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:43.053939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130a58-f846-4dff-bfff-0c46ad057348 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:43.054216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73130a58-f846-4dff-bfff-0c46ad057348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:43.054955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73130a58-f846-4dff-bfff-0c46ad057348 None admin] RBAC: Adding query filter params (role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=0724cd133fb748b58b6389d4ddb3478a, user.id=62419e76eac94a61b44066fc9bade636) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:43.055262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73130a58-f846-4dff-bfff-0c46ad057348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:43.056788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73130a58-f846-4dff-bfff-0c46ad057348 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:43.066638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 50/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:42 2022] GET /identity/v3/role_assignments?user.id=62419e76eac94a61b44066fc9bade636&scope.project.id=0724cd133fb748b58b6389d4ddb3478a&role.id=165f39c0a24042fdacc0121c96347bcd => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:45.114312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eccdee-bf15-49dc-af70-21a4a1518c9d None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.115320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eccdee-bf15-49dc-af70-21a4a1518c9d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.115801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eccdee-bf15-49dc-af70-21a4a1518c9d None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.117361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 48/98] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:45.135080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126f214-c7f9-4ca7-9a57-ef8bf0c45c8d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.135943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126f214-c7f9-4ca7-9a57-ef8bf0c45c8d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.136443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8126f214-c7f9-4ca7-9a57-ef8bf0c45c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.141439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bebe3-9480-418b-9a8c-b4b2dc5cc619 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.141790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bebe3-9480-418b-9a8c-b4b2dc5cc619 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.142069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bebe3-9480-418b-9a8c-b4b2dc5cc619 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.143501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 49/99] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:45.148457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4dc28-abce-454b-a6cf-6720077205e6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.148946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4dc28-abce-454b-a6cf-6720077205e6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.149446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4dc28-abce-454b-a6cf-6720077205e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.165153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8126f214-c7f9-4ca7-9a57-ef8bf0c45c8d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:45.166352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8126f214-c7f9-4ca7-9a57-ef8bf0c45c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:45.178668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7ff4dc28-abce-454b-a6cf-6720077205e6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:45.181714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7ff4dc28-abce-454b-a6cf-6720077205e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:45.269838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:45.275789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 50/100] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:45.285349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 51/101] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:45.612299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4dc28-abce-454b-a6cf-6720077205e6 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:45.638470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ac805-fec6-4595-8358-cee6f47823f3 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.639104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ac805-fec6-4595-8358-cee6f47823f3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.639837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96ac805-fec6-4595-8358-cee6f47823f3 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.641373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 52/102] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:34:45.655541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7c5b6-11cb-4166-8a1e-9d804771bfb9 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.656081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7c5b6-11cb-4166-8a1e-9d804771bfb9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.656548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7c5b6-11cb-4166-8a1e-9d804771bfb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.684769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-bfa7c5b6-11cb-4166-8a1e-9d804771bfb9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:45.686285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bfa7c5b6-11cb-4166-8a1e-9d804771bfb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:45.786978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4dc28-abce-454b-a6cf-6720077205e6 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:45.808559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 53/103] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:45.809824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7c5b6-11cb-4166-8a1e-9d804771bfb9 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:45.855070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:45.881588 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485e7d1-589f-4663-8891-ca8e9d94a16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:45.882263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e7d1-589f-4663-8891-ca8e9d94a16b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:45.882549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e7d1-589f-4663-8891-ca8e9d94a16b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:45.882830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1485e7d1-589f-4663-8891-ca8e9d94a16b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:45.906871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1485e7d1-589f-4663-8891-ca8e9d94a16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-1485e7d1-589f-4663-8891-ca8e9d94a16b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:45.916155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:45.917005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:45.917838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 51/104] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:45.930440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485e7d1-589f-4663-8891-ca8e9d94a16b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.025842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.042618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7c5b6-11cb-4166-8a1e-9d804771bfb9 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.089990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135b6c4-91f9-4be1-9770-a0eb93407713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.090655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135b6c4-91f9-4be1-9770-a0eb93407713 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.090941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135b6c4-91f9-4be1-9770-a0eb93407713 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.091222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135b6c4-91f9-4be1-9770-a0eb93407713 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.092420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135b6c4-91f9-4be1-9770-a0eb93407713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.093946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135b6c4-91f9-4be1-9770-a0eb93407713 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.096181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 54/105] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:46.101576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135b6c4-91f9-4be1-9770-a0eb93407713 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.145923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1485e7d1-589f-4663-8891-ca8e9d94a16b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.206204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135b6c4-91f9-4be1-9770-a0eb93407713 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.218807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.227002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c8fb6-bf1c-419d-87c4-c1849eb02de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.227629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8fb6-bf1c-419d-87c4-c1849eb02de2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.227909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8fb6-bf1c-419d-87c4-c1849eb02de2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.228192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c8fb6-bf1c-419d-87c4-c1849eb02de2 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.228875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c8fb6-bf1c-419d-87c4-c1849eb02de2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:46.229177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c8fb6-bf1c-419d-87c4-c1849eb02de2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.230591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c8fb6-bf1c-419d-87c4-c1849eb02de2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.242532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a242d9-025e-477b-b83a-550c2a03db59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.243152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a242d9-025e-477b-b83a-550c2a03db59 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.243437 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a242d9-025e-477b-b83a-550c2a03db59 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.243718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a242d9-025e-477b-b83a-550c2a03db59 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.244380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a242d9-025e-477b-b83a-550c2a03db59 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.245880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a242d9-025e-477b-b83a-550c2a03db59 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.251951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 52/106] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:46.253208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fa577-845b-49a6-bb48-d7e754824215 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.253518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fa577-845b-49a6-bb48-d7e754824215 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.253792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58fa577-845b-49a6-bb48-d7e754824215 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.255276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 53/107] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:46.258777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fa577-845b-49a6-bb48-d7e754824215 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.276130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 55/108] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:34:46 2022] POST /identity/v3/projects => generated 302 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:46.277178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df6812-b44a-4db6-a263-43d21c3aeb93 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.277570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df6812-b44a-4db6-a263-43d21c3aeb93 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.277861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df6812-b44a-4db6-a263-43d21c3aeb93 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.283279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 56/109] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:46.283279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47836a9c-437e-49c8-bcba-091921e2f28e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.283279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47836a9c-437e-49c8-bcba-091921e2f28e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.283279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47836a9c-437e-49c8-bcba-091921e2f28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.300929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-47836a9c-437e-49c8-bcba-091921e2f28e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:46.302389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-47836a9c-437e-49c8-bcba-091921e2f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:46.385995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58fa577-845b-49a6-bb48-d7e754824215 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.387444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:46.388710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47836a9c-437e-49c8-bcba-091921e2f28e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.414561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.450363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99adf2-d2c7-4d8c-a9cf-550936248b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.452178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99adf2-d2c7-4d8c-a9cf-550936248b15 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.452463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99adf2-d2c7-4d8c-a9cf-550936248b15 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.452753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99adf2-d2c7-4d8c-a9cf-550936248b15 None admin] PATH_INFO: `/v3/users/12b9f20a52fa41c084459334e2e76384` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.487238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99adf2-d2c7-4d8c-a9cf-550936248b15 None admin] RBAC: Authorizing `identity:get_user(user_id=12b9f20a52fa41c084459334e2e76384)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.488726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99adf2-d2c7-4d8c-a9cf-550936248b15 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.494884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 54/111] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/users/12b9f20a52fa41c084459334e2e76384 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:46.497753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bdd20-b3d5-4d20-bb69-6727795ecccf None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.497753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bdd20-b3d5-4d20-bb69-6727795ecccf None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.497921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bdd20-b3d5-4d20-bb69-6727795ecccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.526917 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-949bdd20-b3d5-4d20-bb69-6727795ecccf None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:46.529366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-949bdd20-b3d5-4d20-bb69-6727795ecccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:46.534468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.567206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47836a9c-437e-49c8-bcba-091921e2f28e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.611058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b9ba4c-ee27-4449-a1c6-948c3aa70102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.611370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ba4c-ee27-4449-a1c6-948c3aa70102 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.611582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ba4c-ee27-4449-a1c6-948c3aa70102 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.611854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b9ba4c-ee27-4449-a1c6-948c3aa70102 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.617921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 55/112] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:46.619374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bdd20-b3d5-4d20-bb69-6727795ecccf None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.625311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b9ba4c-ee27-4449-a1c6-948c3aa70102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-29b9ba4c-ee27-4449-a1c6-948c3aa70102 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:46.631491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:46.632353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:46.633119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 58/113] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:46.634332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67fabf-b4c2-4725-9ca7-471c4c8d7f87 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.634544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67fabf-b4c2-4725-9ca7-471c4c8d7f87 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.634818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d67fabf-b4c2-4725-9ca7-471c4c8d7f87 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.636624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 59/114] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:46.641389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67fabf-b4c2-4725-9ca7-471c4c8d7f87 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.745447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bdd20-b3d5-4d20-bb69-6727795ecccf None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.755322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.787552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abddf2-616d-4a39-b8e1-8bf0e630de9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.788624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abddf2-616d-4a39-b8e1-8bf0e630de9d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.789047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abddf2-616d-4a39-b8e1-8bf0e630de9d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.789329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3abddf2-616d-4a39-b8e1-8bf0e630de9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.791636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d67fabf-b4c2-4725-9ca7-471c4c8d7f87 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:46.843017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ba3c6-fc43-4fcf-97bd-f45080aebab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:46.843667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba3c6-fc43-4fcf-97bd-f45080aebab2 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.843949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba3c6-fc43-4fcf-97bd-f45080aebab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.844224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ba3c6-fc43-4fcf-97bd-f45080aebab2 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.844934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ba3c6-fc43-4fcf-97bd-f45080aebab2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:46.845240 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ba3c6-fc43-4fcf-97bd-f45080aebab2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.846664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ba3c6-fc43-4fcf-97bd-f45080aebab2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.848053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:46.860146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 60/115] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:46.862059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61008-2bc9-428b-b1cb-0d228ac1e92b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:46.862361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61008-2bc9-428b-b1cb-0d228ac1e92b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:46.862633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d61008-2bc9-428b-b1cb-0d228ac1e92b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:46.872030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abddf2-616d-4a39-b8e1-8bf0e630de9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:46.873783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3abddf2-616d-4a39-b8e1-8bf0e630de9d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:46.880861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-31d61008-2bc9-428b-b1cb-0d228ac1e92b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:46.882082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-31d61008-2bc9-428b-b1cb-0d228ac1e92b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:46.977062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 61/116] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:46.978286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61008-2bc9-428b-b1cb-0d228ac1e92b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:46.997725 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 56/117] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:46.998831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abddf2-616d-4a39-b8e1-8bf0e630de9d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.007314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.095600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d61008-2bc9-428b-b1cb-0d228ac1e92b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.107982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3abddf2-616d-4a39-b8e1-8bf0e630de9d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.123372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.132995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84743b-4b43-4954-ac68-7751006ddf31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.133943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84743b-4b43-4954-ac68-7751006ddf31 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.134514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84743b-4b43-4954-ac68-7751006ddf31 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.134977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84743b-4b43-4954-ac68-7751006ddf31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.146117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e3284-1211-48d1-bd96-49a1ff4f954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.146754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3284-1211-48d1-bd96-49a1ff4f954c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.147036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3284-1211-48d1-bd96-49a1ff4f954c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.147312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3e3284-1211-48d1-bd96-49a1ff4f954c None admin] PATH_INFO: `/v3/users/62419e76eac94a61b44066fc9bade636` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.148443 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e3284-1211-48d1-bd96-49a1ff4f954c None admin] RBAC: Authorizing `identity:get_user(user_id=62419e76eac94a61b44066fc9bade636)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.152973 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3e3284-1211-48d1-bd96-49a1ff4f954c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.153101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84743b-4b43-4954-ac68-7751006ddf31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:47.153180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 57/118] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/users/62419e76eac94a61b44066fc9bade636 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.153180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e3284-1211-48d1-bd96-49a1ff4f954c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-ce84743b-4b43-4954-ac68-7751006ddf31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:47.155442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:47.156285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:47.157060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:47.159822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 62/119] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:47.160808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84743b-4b43-4954-ac68-7751006ddf31 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.238274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.270010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3e3284-1211-48d1-bd96-49a1ff4f954c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.293539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84743b-4b43-4954-ac68-7751006ddf31 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.319737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1ea76-65f9-451b-b85a-2843ae4436f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.320653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ea76-65f9-451b-b85a-2843ae4436f5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.321100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ea76-65f9-451b-b85a-2843ae4436f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.321552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e1ea76-65f9-451b-b85a-2843ae4436f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.331706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f77c4-25c6-4e00-80c6-4fc67f094913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.332335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f77c4-25c6-4e00-80c6-4fc67f094913 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.332615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f77c4-25c6-4e00-80c6-4fc67f094913 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.332717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e1ea76-65f9-451b-b85a-2843ae4436f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:47.332888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7f77c4-25c6-4e00-80c6-4fc67f094913 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.334041 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f77c4-25c6-4e00-80c6-4fc67f094913 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.335510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7f77c4-25c6-4e00-80c6-4fc67f094913 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.341443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 63/120] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-17e1ea76-65f9-451b-b85a-2843ae4436f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:47.341571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:47.342398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:47.343330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:47.344021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f77c4-25c6-4e00-80c6-4fc67f094913 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.344106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 58/121] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:47.345125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1ea76-65f9-451b-b85a-2843ae4436f5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.408868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.458062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7f77c4-25c6-4e00-80c6-4fc67f094913 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.459518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e1ea76-65f9-451b-b85a-2843ae4436f5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.493147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593be722-0273-47d5-8daf-4985d5ba6141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.493814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be722-0273-47d5-8daf-4985d5ba6141 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.494101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be722-0273-47d5-8daf-4985d5ba6141 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.494196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a464d-1ce5-4213-9943-480d115f5029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.494403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593be722-0273-47d5-8daf-4985d5ba6141 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.494704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a464d-1ce5-4213-9943-480d115f5029 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.494986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a464d-1ce5-4213-9943-480d115f5029 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.495264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1a464d-1ce5-4213-9943-480d115f5029 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.495521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593be722-0273-47d5-8daf-4985d5ba6141 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.495929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a464d-1ce5-4213-9943-480d115f5029 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:47.496234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a464d-1ce5-4213-9943-480d115f5029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.497016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593be722-0273-47d5-8daf-4985d5ba6141 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.497707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1a464d-1ce5-4213-9943-480d115f5029 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.498693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 64/122] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.499458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593be722-0273-47d5-8daf-4985d5ba6141 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.499631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.508084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 59/123] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.508776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a464d-1ce5-4213-9943-480d115f5029 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.618043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593be722-0273-47d5-8daf-4985d5ba6141 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.623962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1a464d-1ce5-4213-9943-480d115f5029 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.642678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.656142 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b7874-1e23-4438-b3df-3136795859be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.656871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b7874-1e23-4438-b3df-3136795859be None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.657793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b7874-1e23-4438-b3df-3136795859be None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.658071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7b7874-1e23-4438-b3df-3136795859be None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.663686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951141d6-a0ed-4888-bd1a-42e93c6badc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.664707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951141d6-a0ed-4888-bd1a-42e93c6badc9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.665180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951141d6-a0ed-4888-bd1a-42e93c6badc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.665669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951141d6-a0ed-4888-bd1a-42e93c6badc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.666592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951141d6-a0ed-4888-bd1a-42e93c6badc9 None admin] RBAC: Adding query filter params (role.id=f7cd8cb4f15b496e933c06d4f359a934, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c, user.id=12b9f20a52fa41c084459334e2e76384) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:47.667124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951141d6-a0ed-4888-bd1a-42e93c6badc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.668818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951141d6-a0ed-4888-bd1a-42e93c6badc9 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.668991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7b7874-1e23-4438-b3df-3136795859be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-8d7b7874-1e23-4438-b3df-3136795859be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:47.674207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:47.675048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:47.675811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 65/124] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:47.676417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b7874-1e23-4438-b3df-3136795859be None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.677907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 60/125] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/role_assignments?user.id=12b9f20a52fa41c084459334e2e76384&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=f7cd8cb4f15b496e933c06d4f359a934 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.678920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951141d6-a0ed-4888-bd1a-42e93c6badc9 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.813321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7b7874-1e23-4438-b3df-3136795859be None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.853874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9d861-689a-43b9-ab33-76dc464e0261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:47.853874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9d861-689a-43b9-ab33-76dc464e0261 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:47.853874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9d861-689a-43b9-ab33-76dc464e0261 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:47.853874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9d861-689a-43b9-ab33-76dc464e0261 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:47.854274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9d861-689a-43b9-ab33-76dc464e0261 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:47.854274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9d861-689a-43b9-ab33-76dc464e0261 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:47.855187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9d861-689a-43b9-ab33-76dc464e0261 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:47.866318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:47.867915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 66/126] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:47.868873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9d861-689a-43b9-ab33-76dc464e0261 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:47.962241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951141d6-a0ed-4888-bd1a-42e93c6badc9 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:47.966213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.024724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668d5f8-889d-4a3f-a30c-3342454ba3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.025893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668d5f8-889d-4a3f-a30c-3342454ba3e8 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.026377 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668d5f8-889d-4a3f-a30c-3342454ba3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.026848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1668d5f8-889d-4a3f-a30c-3342454ba3e8 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/users/62419e76eac94a61b44066fc9bade636/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.030147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668d5f8-889d-4a3f-a30c-3342454ba3e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=03f14f0de738463fb2bbfd5a2b20739c, user_id=62419e76eac94a61b44066fc9bade636, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.033016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1668d5f8-889d-4a3f-a30c-3342454ba3e8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.052431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 61/127] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:47 2022] PUT /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/users/62419e76eac94a61b44066fc9bade636/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:34:48.057803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9d861-689a-43b9-ab33-76dc464e0261 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.060087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668d5f8-889d-4a3f-a30c-3342454ba3e8 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.115176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cbf86-0c93-4656-ae9b-568774bae2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.115828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cbf86-0c93-4656-ae9b-568774bae2d1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.116128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cbf86-0c93-4656-ae9b-568774bae2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.116388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37cbf86-0c93-4656-ae9b-568774bae2d1 None admin] PATH_INFO: `/v3/users/50b388ebd083407da9c5b53df1e1692d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.118515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cbf86-0c93-4656-ae9b-568774bae2d1 None admin] RBAC: Authorizing `identity:get_user(user_id=50b388ebd083407da9c5b53df1e1692d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.120006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37cbf86-0c93-4656-ae9b-568774bae2d1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.125645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 67/128] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:47 2022] GET /identity/v3/users/50b388ebd083407da9c5b53df1e1692d => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.127849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cbf86-0c93-4656-ae9b-568774bae2d1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.288168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1668d5f8-889d-4a3f-a30c-3342454ba3e8 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.314787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.320084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37cbf86-0c93-4656-ae9b-568774bae2d1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.336198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.336722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32413cbd-00fc-4be0-a3e3-f75a1120859f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.338539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32413cbd-00fc-4be0-a3e3-f75a1120859f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.339013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32413cbd-00fc-4be0-a3e3-f75a1120859f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.339447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32413cbd-00fc-4be0-a3e3-f75a1120859f None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.340528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32413cbd-00fc-4be0-a3e3-f75a1120859f None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:48.341324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32413cbd-00fc-4be0-a3e3-f75a1120859f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.342933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32413cbd-00fc-4be0-a3e3-f75a1120859f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.354277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 62/129] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.355534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32413cbd-00fc-4be0-a3e3-f75a1120859f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.362431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010052f4-ac10-425e-a6aa-cee3489b949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.363077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010052f4-ac10-425e-a6aa-cee3489b949b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.363358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010052f4-ac10-425e-a6aa-cee3489b949b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.363636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010052f4-ac10-425e-a6aa-cee3489b949b None admin] PATH_INFO: `/v3/users/62419e76eac94a61b44066fc9bade636` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.364763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010052f4-ac10-425e-a6aa-cee3489b949b None admin] RBAC: Authorizing `identity:get_user(user_id=62419e76eac94a61b44066fc9bade636)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.366489 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010052f4-ac10-425e-a6aa-cee3489b949b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.368234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 68/130] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:48 2022] GET /identity/v3/users/62419e76eac94a61b44066fc9bade636 => generated 275 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.369145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010052f4-ac10-425e-a6aa-cee3489b949b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.473545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32413cbd-00fc-4be0-a3e3-f75a1120859f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.535078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034294aa-37b5-404b-a5a6-fc34b8504970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.536130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034294aa-37b5-404b-a5a6-fc34b8504970 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.536646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034294aa-37b5-404b-a5a6-fc34b8504970 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.537122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034294aa-37b5-404b-a5a6-fc34b8504970 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.539287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034294aa-37b5-404b-a5a6-fc34b8504970 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.541150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034294aa-37b5-404b-a5a6-fc34b8504970 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.544286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 63/131] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:48 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.546792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034294aa-37b5-404b-a5a6-fc34b8504970 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.555287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010052f4-ac10-425e-a6aa-cee3489b949b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.630158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf8bb0-800c-4f1a-b4ec-c893c3871272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.631176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf8bb0-800c-4f1a-b4ec-c893c3871272 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.631681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf8bb0-800c-4f1a-b4ec-c893c3871272 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.632213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdf8bb0-800c-4f1a-b4ec-c893c3871272 None admin] PATH_INFO: `/v3/users/62419e76eac94a61b44066fc9bade636` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.633847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf8bb0-800c-4f1a-b4ec-c893c3871272 None admin] RBAC: Authorizing `identity:get_user(user_id=62419e76eac94a61b44066fc9bade636)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.637070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdf8bb0-800c-4f1a-b4ec-c893c3871272 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.641816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 69/132] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:48 2022] GET /identity/v3/users/62419e76eac94a61b44066fc9bade636 => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.643639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf8bb0-800c-4f1a-b4ec-c893c3871272 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.646878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.744092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034294aa-37b5-404b-a5a6-fc34b8504970 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.775141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.781047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22b739-5509-4e47-b994-605676ea3afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.781742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22b739-5509-4e47-b994-605676ea3afe None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.782591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22b739-5509-4e47-b994-605676ea3afe None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.782827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e22b739-5509-4e47-b994-605676ea3afe None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.783987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22b739-5509-4e47-b994-605676ea3afe None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.785605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e22b739-5509-4e47-b994-605676ea3afe None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.787636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 64/133] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:48 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.788468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22b739-5509-4e47-b994-605676ea3afe None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.867509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdf8bb0-800c-4f1a-b4ec-c893c3871272 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.903897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdef61-fa5b-4921-849f-8bee644946ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.904958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdef61-fa5b-4921-849f-8bee644946ff None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.905369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdef61-fa5b-4921-849f-8bee644946ff None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.905801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fdef61-fa5b-4921-849f-8bee644946ff None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/users/50b388ebd083407da9c5b53df1e1692d/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.907862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e22b739-5509-4e47-b994-605676ea3afe None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:48.908207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdef61-fa5b-4921-849f-8bee644946ff None admin] RBAC: Authorizing `identity:create_grant(project_id=03f14f0de738463fb2bbfd5a2b20739c, user_id=50b388ebd083407da9c5b53df1e1692d, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.909974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fdef61-fa5b-4921-849f-8bee644946ff None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.929141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 70/134] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:48 2022] PUT /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/users/50b388ebd083407da9c5b53df1e1692d/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:34:48.931269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdef61-fa5b-4921-849f-8bee644946ff None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:48.941329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:48.987559 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b7b04-2cac-49c7-9c89-733b140c8309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:48.988224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b7b04-2cac-49c7-9c89-733b140c8309 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.988512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b7b04-2cac-49c7-9c89-733b140c8309 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.988794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b7b04-2cac-49c7-9c89-733b140c8309 None admin] PATH_INFO: `/v3/projects/0724cd133fb748b58b6389d4ddb3478a` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:48.994358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b7b04-2cac-49c7-9c89-733b140c8309 None admin] RBAC: Authorizing `identity:get_project(project_id=0724cd133fb748b58b6389d4ddb3478a)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:48.995879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b7b04-2cac-49c7-9c89-733b140c8309 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:48.998049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 65/135] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:48 2022] GET /identity/v3/projects/0724cd133fb748b58b6389d4ddb3478a => generated 312 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:48.999312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cc621-824f-4b0c-a5a5-0bdba56f819a None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:48.999598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cc621-824f-4b0c-a5a5-0bdba56f819a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:48.999873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cc621-824f-4b0c-a5a5-0bdba56f819a None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.001675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 66/136] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:49.010485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cc621-824f-4b0c-a5a5-0bdba56f819a None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:49.067101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fdef61-fa5b-4921-849f-8bee644946ff None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:49.077499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:49.111090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a58a69-8166-4a43-ab63-7d136c4e22fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:49.111788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a58a69-8166-4a43-ab63-7d136c4e22fc None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:49.112092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a58a69-8166-4a43-ab63-7d136c4e22fc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:49.112372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a58a69-8166-4a43-ab63-7d136c4e22fc None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/users/62419e76eac94a61b44066fc9bade636/roles/1f5abd9c8afd411ebac7cd79bb5f1230` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.117195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a58a69-8166-4a43-ab63-7d136c4e22fc None admin] RBAC: Authorizing `identity:create_grant(project_id=03f14f0de738463fb2bbfd5a2b20739c, user_id=62419e76eac94a61b44066fc9bade636, role_id=1f5abd9c8afd411ebac7cd79bb5f1230)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:49.119892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a58a69-8166-4a43-ab63-7d136c4e22fc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:49.144572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 71/137] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:48 2022] PUT /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/users/62419e76eac94a61b44066fc9bade636/roles/1f5abd9c8afd411ebac7cd79bb5f1230 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:34:49.145909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b875c7b-f2bc-4c0d-8b36-61ba251bfd1f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:49.146250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b875c7b-f2bc-4c0d-8b36-61ba251bfd1f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:49.146537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b875c7b-f2bc-4c0d-8b36-61ba251bfd1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.186658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-6b875c7b-f2bc-4c0d-8b36-61ba251bfd1f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:49.187922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-6b875c7b-f2bc-4c0d-8b36-61ba251bfd1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:49.197694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cc621-824f-4b0c-a5a5-0bdba56f819a None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:49.241066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbc772-8bf9-47e5-847d-bd617c6527cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:49.241820 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbc772-8bf9-47e5-847d-bd617c6527cc None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:49.242513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbc772-8bf9-47e5-847d-bd617c6527cc None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:49.242932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbc772-8bf9-47e5-847d-bd617c6527cc None admin] PATH_INFO: `/v3/projects/0724cd133fb748b58b6389d4ddb3478a/users/62419e76eac94a61b44066fc9bade636/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.245212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbc772-8bf9-47e5-847d-bd617c6527cc None admin] RBAC: Authorizing `identity:create_grant(project_id=0724cd133fb748b58b6389d4ddb3478a, user_id=62419e76eac94a61b44066fc9bade636, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:49.246866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbc772-8bf9-47e5-847d-bd617c6527cc None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:49.263364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 67/138] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:49 2022] PUT /identity/v3/projects/0724cd133fb748b58b6389d4ddb3478a/users/62419e76eac94a61b44066fc9bade636/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:34:49.305881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 72/139] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:49.666172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbc772-8bf9-47e5-847d-bd617c6527cc None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:49.716331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:49.773850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbc772-8bf9-47e5-847d-bd617c6527cc None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:49.807958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e273fe73-838d-4d38-9f3f-443a1d8f9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:49.808627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273fe73-838d-4d38-9f3f-443a1d8f9180 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:49.808919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273fe73-838d-4d38-9f3f-443a1d8f9180 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:49.809191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e273fe73-838d-4d38-9f3f-443a1d8f9180 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.810343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273fe73-838d-4d38-9f3f-443a1d8f9180 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:49.811797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e273fe73-838d-4d38-9f3f-443a1d8f9180 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:49.813782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 68/140] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:49.819243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b875c7b-f2bc-4c0d-8b36-61ba251bfd1f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:49.933173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:49.937921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b875c7b-f2bc-4c0d-8b36-61ba251bfd1f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:49.981778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd879623-d0bc-4f15-ae53-c349ca94c9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:49.982711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879623-d0bc-4f15-ae53-c349ca94c9fa None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:49.983212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879623-d0bc-4f15-ae53-c349ca94c9fa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:49.983682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd879623-d0bc-4f15-ae53-c349ca94c9fa None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:49.984552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd879623-d0bc-4f15-ae53-c349ca94c9fa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:49.986948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd879623-d0bc-4f15-ae53-c349ca94c9fa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:50.025301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 73/141] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:34:49 2022] POST /identity/v3/users => generated 283 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:50.456976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcb94a-7a58-4ccf-a8ea-59cd869c7b75 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.457687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcb94a-7a58-4ccf-a8ea-59cd869c7b75 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.458193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fcb94a-7a58-4ccf-a8ea-59cd869c7b75 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.459755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 69/142] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:50.465752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524622-895d-4958-bcd0-e819a60fecc4 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.466344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524622-895d-4958-bcd0-e819a60fecc4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.466626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25524622-895d-4958-bcd0-e819a60fecc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.490474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-25524622-895d-4958-bcd0-e819a60fecc4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:50.491666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-25524622-895d-4958-bcd0-e819a60fecc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:50.582256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 74/143] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:50.821210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4a5c6-545a-4e26-a71d-784f05eace24 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.822237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4a5c6-545a-4e26-a71d-784f05eace24 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.822756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f4a5c6-545a-4e26-a71d-784f05eace24 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.824304 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 70/144] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:50.830235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feb867-76ad-458e-941a-dbe70249189c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:50.830678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feb867-76ad-458e-941a-dbe70249189c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:50.830867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feb867-76ad-458e-941a-dbe70249189c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:50.854503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-81feb867-76ad-458e-941a-dbe70249189c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:50.855718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-81feb867-76ad-458e-941a-dbe70249189c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:50.898085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4a5c6-545a-4e26-a71d-784f05eace24 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:50.952045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 75/145] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:51.027298 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f4a5c6-545a-4e26-a71d-784f05eace24 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.042621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.064221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3e426-d872-4ef3-b28d-e369fe3481aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.065223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3e426-d872-4ef3-b28d-e369fe3481aa None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.065740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3e426-d872-4ef3-b28d-e369fe3481aa None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.066228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc3e426-d872-4ef3-b28d-e369fe3481aa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.083734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc3e426-d872-4ef3-b28d-e369fe3481aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-2cc3e426-d872-4ef3-b28d-e369fe3481aa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:51.089169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:51.090070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:51.090866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:51.093093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 71/146] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:51.100067 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feb867-76ad-458e-941a-dbe70249189c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.124729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.227805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feb867-76ad-458e-941a-dbe70249189c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.268746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f431b-82fe-4969-ba9e-1f31ca082df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.269373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f431b-82fe-4969-ba9e-1f31ca082df2 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.269709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f431b-82fe-4969-ba9e-1f31ca082df2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.269990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f431b-82fe-4969-ba9e-1f31ca082df2 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.270671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f431b-82fe-4969-ba9e-1f31ca082df2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:51.270975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f431b-82fe-4969-ba9e-1f31ca082df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:51.272368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f431b-82fe-4969-ba9e-1f31ca082df2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:51.282411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 76/147] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:51.288357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3e426-d872-4ef3-b28d-e369fe3481aa None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.336225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f431b-82fe-4969-ba9e-1f31ca082df2 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.499087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc3e426-d872-4ef3-b28d-e369fe3481aa None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.500367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.555669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f431b-82fe-4969-ba9e-1f31ca082df2 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.597037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47425bb0-52ba-45e0-8719-209ec8652116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.597801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47425bb0-52ba-45e0-8719-209ec8652116 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.598093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47425bb0-52ba-45e0-8719-209ec8652116 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.598381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47425bb0-52ba-45e0-8719-209ec8652116 None admin] PATH_INFO: `/v3/users/12b9f20a52fa41c084459334e2e76384` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.601012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47425bb0-52ba-45e0-8719-209ec8652116 None admin] RBAC: Authorizing `identity:get_user(user_id=12b9f20a52fa41c084459334e2e76384)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:51.602532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47425bb0-52ba-45e0-8719-209ec8652116 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:51.605752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 72/148] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:51 2022] GET /identity/v3/users/12b9f20a52fa41c084459334e2e76384 => generated 289 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:51.616644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47425bb0-52ba-45e0-8719-209ec8652116 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.646023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc955703-f20e-4d71-b37e-e42f0054a436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.646671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc955703-f20e-4d71-b37e-e42f0054a436 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.646950 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc955703-f20e-4d71-b37e-e42f0054a436 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.647224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc955703-f20e-4d71-b37e-e42f0054a436 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.674943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.680785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc955703-f20e-4d71-b37e-e42f0054a436 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-bc955703-f20e-4d71-b37e-e42f0054a436 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:51.686159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:51.687080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:51.687833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:51.690792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 77/149] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:51.708447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc955703-f20e-4d71-b37e-e42f0054a436 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.752210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47425bb0-52ba-45e0-8719-209ec8652116 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.799704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d433ecf-389d-423d-8f18-5cb5fc999117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.800366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d433ecf-389d-423d-8f18-5cb5fc999117 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.800663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d433ecf-389d-423d-8f18-5cb5fc999117 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.800947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d433ecf-389d-423d-8f18-5cb5fc999117 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.802331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d433ecf-389d-423d-8f18-5cb5fc999117 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:51.803910 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d433ecf-389d-423d-8f18-5cb5fc999117 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:51.809959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 73/150] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:51 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:51.819724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d433ecf-389d-423d-8f18-5cb5fc999117 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.856429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc955703-f20e-4d71-b37e-e42f0054a436 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.899558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789b14c-4b90-4393-8a3c-d1b2e351118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:51.900180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789b14c-4b90-4393-8a3c-d1b2e351118c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:51.900634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789b14c-4b90-4393-8a3c-d1b2e351118c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:51.901053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b789b14c-4b90-4393-8a3c-d1b2e351118c None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:51.901900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789b14c-4b90-4393-8a3c-d1b2e351118c None admin] RBAC: Adding query filter params (name=member) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:51.902356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789b14c-4b90-4393-8a3c-d1b2e351118c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:51.903900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b789b14c-4b90-4393-8a3c-d1b2e351118c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:51.906523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:51.920272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 78/151] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:51.944590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789b14c-4b90-4393-8a3c-d1b2e351118c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:51.961202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d433ecf-389d-423d-8f18-5cb5fc999117 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:51.973930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:52.008144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a996db-1d0c-445c-8654-49610a382d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:52.009092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a996db-1d0c-445c-8654-49610a382d0d None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.009583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a996db-1d0c-445c-8654-49610a382d0d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.010028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a996db-1d0c-445c-8654-49610a382d0d None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/users/12b9f20a52fa41c084459334e2e76384/roles/f7cd8cb4f15b496e933c06d4f359a934` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.014974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a996db-1d0c-445c-8654-49610a382d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=03f14f0de738463fb2bbfd5a2b20739c, user_id=12b9f20a52fa41c084459334e2e76384, role_id=f7cd8cb4f15b496e933c06d4f359a934)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:52.016780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a996db-1d0c-445c-8654-49610a382d0d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:52.043666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 74/152] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:34:51 2022] PUT /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/users/12b9f20a52fa41c084459334e2e76384/roles/f7cd8cb4f15b496e933c06d4f359a934 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:34:52.068371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b789b14c-4b90-4393-8a3c-d1b2e351118c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:52.107327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e695d-adef-4e59-a12f-c149f7d04851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:52.107897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e695d-adef-4e59-a12f-c149f7d04851 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.108173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e695d-adef-4e59-a12f-c149f7d04851 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.108445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e695d-adef-4e59-a12f-c149f7d04851 None admin] PATH_INFO: `/v3/users/62419e76eac94a61b44066fc9bade636` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.109732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e695d-adef-4e59-a12f-c149f7d04851 None admin] RBAC: Authorizing `identity:get_user(user_id=62419e76eac94a61b44066fc9bade636)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:52.111851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e695d-adef-4e59-a12f-c149f7d04851 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:52.113945 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 79/153] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:51 2022] GET /identity/v3/users/62419e76eac94a61b44066fc9bade636 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:52.119679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a996db-1d0c-445c-8654-49610a382d0d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:52.256442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a996db-1d0c-445c-8654-49610a382d0d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:52.303309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdd378-cf98-4e70-9c6d-46680333e367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:52.303953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdd378-cf98-4e70-9c6d-46680333e367 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.304236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdd378-cf98-4e70-9c6d-46680333e367 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.304513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdd378-cf98-4e70-9c6d-46680333e367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.364524 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:52.400565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdd378-cf98-4e70-9c6d-46680333e367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:52.402076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cdd378-cf98-4e70-9c6d-46680333e367 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:52.543357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 75/154] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:52.549101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e695d-adef-4e59-a12f-c149f7d04851 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:52.644230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:52.684520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e695d-adef-4e59-a12f-c149f7d04851 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:52.722293 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d19640f-ecc1-4963-9112-727f04d19a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:52.722943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19640f-ecc1-4963-9112-727f04d19a6b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.723280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19640f-ecc1-4963-9112-727f04d19a6b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.723560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d19640f-ecc1-4963-9112-727f04d19a6b None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.724684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19640f-ecc1-4963-9112-727f04d19a6b None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:52.726172 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d19640f-ecc1-4963-9112-727f04d19a6b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:52.728088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 80/155] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:52 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:52.733737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdd378-cf98-4e70-9c6d-46680333e367 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:52.830244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:52.842144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28763dc4-f553-4690-a23f-7df6d41999e8 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.842577 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28763dc4-f553-4690-a23f-7df6d41999e8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.843072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28763dc4-f553-4690-a23f-7df6d41999e8 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.844931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 81/156] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:52.850563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c354-768e-42ee-95c1-016f877a2c94 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.850951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c354-768e-42ee-95c1-016f877a2c94 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.851324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9121c354-768e-42ee-95c1-016f877a2c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.869450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdd378-cf98-4e70-9c6d-46680333e367 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:52.871482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9121c354-768e-42ee-95c1-016f877a2c94 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:52.873353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9121c354-768e-42ee-95c1-016f877a2c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:52.912401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5533409-233e-497c-9cd6-5cba63cd3cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:52.912941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533409-233e-497c-9cd6-5cba63cd3cdd None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:52.913225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533409-233e-497c-9cd6-5cba63cd3cdd None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:52.913538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5533409-233e-497c-9cd6-5cba63cd3cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:52.914291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5533409-233e-497c-9cd6-5cba63cd3cdd None admin] RBAC: Adding query filter params (role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c, user.id=62419e76eac94a61b44066fc9bade636) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:52.914603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5533409-233e-497c-9cd6-5cba63cd3cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:52.916056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5533409-233e-497c-9cd6-5cba63cd3cdd None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:52.923673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 76/157] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:52 2022] GET /identity/v3/role_assignments?user.id=62419e76eac94a61b44066fc9bade636&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=165f39c0a24042fdacc0121c96347bcd => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:52.955217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 82/158] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:34:53.180928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07fdf1-f346-4391-ab00-317e8c2b5000 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.181761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07fdf1-f346-4391-ab00-317e8c2b5000 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.182207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07fdf1-f346-4391-ab00-317e8c2b5000 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.183782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 77/159] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:53.195745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae085f-87d5-4dff-8c43-4d4850218d21 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.196030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae085f-87d5-4dff-8c43-4d4850218d21 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.196294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bae085f-87d5-4dff-8c43-4d4850218d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.219272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2bae085f-87d5-4dff-8c43-4d4850218d21 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:53.221022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2bae085f-87d5-4dff-8c43-4d4850218d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:53.287866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:53.296211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 83/160] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:53.334369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a8a86-d1f0-4f8f-aa1b-786ba06f21df None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.334984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a8a86-d1f0-4f8f-aa1b-786ba06f21df None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.335462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a8a86-d1f0-4f8f-aa1b-786ba06f21df None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.337275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 78/161] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:53.342764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc60607-7a36-4913-895f-03f68e69b7dc None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.343047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc60607-7a36-4913-895f-03f68e69b7dc None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.343460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc60607-7a36-4913-895f-03f68e69b7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.363459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-dcc60607-7a36-4913-895f-03f68e69b7dc None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:53.364630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-dcc60607-7a36-4913-895f-03f68e69b7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:53.445359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 84/162] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:53.553886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a8a86-d1f0-4f8f-aa1b-786ba06f21df None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.674624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a8a86-d1f0-4f8f-aa1b-786ba06f21df None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:53.711351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f749048-d6df-4639-9201-a7aa94b65742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:53.711925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749048-d6df-4639-9201-a7aa94b65742 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.712209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749048-d6df-4639-9201-a7aa94b65742 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.712487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f749048-d6df-4639-9201-a7aa94b65742 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.714932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:53.727002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f749048-d6df-4639-9201-a7aa94b65742 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-1f749048-d6df-4639-9201-a7aa94b65742 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:53.732182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:53.733043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:53.733858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 79/163] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:34:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:53.741489 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc60607-7a36-4913-895f-03f68e69b7dc None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.773943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f749048-d6df-4639-9201-a7aa94b65742 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:53.895709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f749048-d6df-4639-9201-a7aa94b65742 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:53.921804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc60607-7a36-4913-895f-03f68e69b7dc None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:53.965155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962a892-83e8-4464-9e44-5ed95beb2fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:53.965748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962a892-83e8-4464-9e44-5ed95beb2fd6 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:53.966032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962a892-83e8-4464-9e44-5ed95beb2fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:53.966305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4962a892-83e8-4464-9e44-5ed95beb2fd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:53.973626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:53.988513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4962a892-83e8-4464-9e44-5ed95beb2fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-4962a892-83e8-4464-9e44-5ed95beb2fd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:53.993929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:53.994779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:53.995550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 80/164] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:34:53.999225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3857-3288-4e84-bf74-fa0a23b06335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:53.999853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3857-3288-4e84-bf74-fa0a23b06335 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.000140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3857-3288-4e84-bf74-fa0a23b06335 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.000395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa3857-3288-4e84-bf74-fa0a23b06335 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.001631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa3857-3288-4e84-bf74-fa0a23b06335 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:54.001941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa3857-3288-4e84-bf74-fa0a23b06335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.003657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa3857-3288-4e84-bf74-fa0a23b06335 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.005857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962a892-83e8-4464-9e44-5ed95beb2fd6 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.021532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 85/165] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:34:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:54.027239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3857-3288-4e84-bf74-fa0a23b06335 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.117022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.208686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4962a892-83e8-4464-9e44-5ed95beb2fd6 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.220667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa3857-3288-4e84-bf74-fa0a23b06335 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.260245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c5a3-dec8-480e-87bc-87c0ef1e5326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.261124 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c5a3-dec8-480e-87bc-87c0ef1e5326 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.261422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c5a3-dec8-480e-87bc-87c0ef1e5326 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.261861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e5c5a3-dec8-480e-87bc-87c0ef1e5326 None admin] PATH_INFO: `/v3/users/62419e76eac94a61b44066fc9bade636` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.262994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5c5a3-dec8-480e-87bc-87c0ef1e5326 None admin] RBAC: Authorizing `identity:get_user(user_id=62419e76eac94a61b44066fc9bade636)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.264474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e5c5a3-dec8-480e-87bc-87c0ef1e5326 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.266070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 86/166] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/users/62419e76eac94a61b44066fc9bade636 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:54.267113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c5a3-dec8-480e-87bc-87c0ef1e5326 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.291426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a256c9-cba5-4379-b456-3f8ee3118b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.292040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a256c9-cba5-4379-b456-3f8ee3118b0c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.292318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a256c9-cba5-4379-b456-3f8ee3118b0c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.292589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a256c9-cba5-4379-b456-3f8ee3118b0c None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.293260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a256c9-cba5-4379-b456-3f8ee3118b0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:54.293585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a256c9-cba5-4379-b456-3f8ee3118b0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.296800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a256c9-cba5-4379-b456-3f8ee3118b0c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.311850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 81/167] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:54.312679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a256c9-cba5-4379-b456-3f8ee3118b0c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.372350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.432187 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a256c9-cba5-4379-b456-3f8ee3118b0c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.454387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.475706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ec993f-c58b-4e54-bca4-898c2af8ec9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.476257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec993f-c58b-4e54-bca4-898c2af8ec9b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.476541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec993f-c58b-4e54-bca4-898c2af8ec9b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.476823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ec993f-c58b-4e54-bca4-898c2af8ec9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.502889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e5c5a3-dec8-480e-87bc-87c0ef1e5326 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.562950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec993f-c58b-4e54-bca4-898c2af8ec9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.564608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ec993f-c58b-4e54-bca4-898c2af8ec9b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.615042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5050c-5c80-4700-9767-b73997268f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.615699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5050c-5c80-4700-9767-b73997268f72 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.615988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5050c-5c80-4700-9767-b73997268f72 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.616266 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5050c-5c80-4700-9767-b73997268f72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.643728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd5050c-5c80-4700-9767-b73997268f72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-4cd5050c-5c80-4700-9767-b73997268f72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:54.649071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:54.649942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:34:54.650746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:54.655415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 87/168] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:54.656336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5050c-5c80-4700-9767-b73997268f72 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.670331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 82/169] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:54.671602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d5e3c-0a2c-4ab3-a949-584ef42aeaa9 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.671887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d5e3c-0a2c-4ab3-a949-584ef42aeaa9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.672167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161d5e3c-0a2c-4ab3-a949-584ef42aeaa9 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.673807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 83/170] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:54.674625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d5e3c-0a2c-4ab3-a949-584ef42aeaa9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.705777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.780725 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161d5e3c-0a2c-4ab3-a949-584ef42aeaa9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.828720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5050c-5c80-4700-9767-b73997268f72 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:54.843243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:54.845093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9d07-b212-4d94-bb2b-8111837867ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.845870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9d07-b212-4d94-bb2b-8111837867ef None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.846223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9d07-b212-4d94-bb2b-8111837867ef None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.846538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b9d07-b212-4d94-bb2b-8111837867ef None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.847369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b9d07-b212-4d94-bb2b-8111837867ef None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:54.847710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b9d07-b212-4d94-bb2b-8111837867ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.849088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4b9d07-b212-4d94-bb2b-8111837867ef None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.866592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54403aa-f46e-40af-8ec2-c4a3a009c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:54.867383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54403aa-f46e-40af-8ec2-c4a3a009c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.867664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54403aa-f46e-40af-8ec2-c4a3a009c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.867936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54403aa-f46e-40af-8ec2-c4a3a009c7d4 None admin] PATH_INFO: `/v3/users/50b388ebd083407da9c5b53df1e1692d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.869059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 84/171] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:54.869994 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9d07-b212-4d94-bb2b-8111837867ef None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:54.873726 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54403aa-f46e-40af-8ec2-c4a3a009c7d4 None admin] RBAC: Authorizing `identity:get_user(user_id=50b388ebd083407da9c5b53df1e1692d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:54.875267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54403aa-f46e-40af-8ec2-c4a3a009c7d4 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:54.877476 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 88/172] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/users/50b388ebd083407da9c5b53df1e1692d => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:54.879866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e75cca-85bc-4ab1-918d-163ba38cb41b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:54.880147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e75cca-85bc-4ab1-918d-163ba38cb41b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:54.880426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e75cca-85bc-4ab1-918d-163ba38cb41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:54.900756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a9e75cca-85bc-4ab1-918d-163ba38cb41b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:54.901976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a9e75cca-85bc-4ab1-918d-163ba38cb41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:55.004232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 89/173] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:55.005817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e75cca-85bc-4ab1-918d-163ba38cb41b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.021752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.058691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b9d07-b212-4d94-bb2b-8111837867ef None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.113499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937835ef-85ab-4ffd-9397-a76ae78e311d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.114140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937835ef-85ab-4ffd-9397-a76ae78e311d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.114419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937835ef-85ab-4ffd-9397-a76ae78e311d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.114693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937835ef-85ab-4ffd-9397-a76ae78e311d None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.115897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937835ef-85ab-4ffd-9397-a76ae78e311d None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.117894 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937835ef-85ab-4ffd-9397-a76ae78e311d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.119530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 85/174] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:54 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:55.121237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937835ef-85ab-4ffd-9397-a76ae78e311d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.266940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e75cca-85bc-4ab1-918d-163ba38cb41b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.275995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937835ef-85ab-4ffd-9397-a76ae78e311d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.307217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.339706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1046b1-2ae1-43fc-b8c5-a11ce392b76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.340670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1046b1-2ae1-43fc-b8c5-a11ce392b76a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.341180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1046b1-2ae1-43fc-b8c5-a11ce392b76a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.341920 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1046b1-2ae1-43fc-b8c5-a11ce392b76a None admin] PATH_INFO: `/v3/users/62419e76eac94a61b44066fc9bade636` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.343270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1046b1-2ae1-43fc-b8c5-a11ce392b76a None admin] RBAC: Authorizing `identity:get_user(user_id=62419e76eac94a61b44066fc9bade636)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.344992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1046b1-2ae1-43fc-b8c5-a11ce392b76a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.346926 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 90/175] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/users/62419e76eac94a61b44066fc9bade636 => generated 275 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:55.347654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84fbea-3ef0-4350-9fbd-ff5d746c7e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.348181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1046b1-2ae1-43fc-b8c5-a11ce392b76a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.348333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84fbea-3ef0-4350-9fbd-ff5d746c7e21 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.348887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84fbea-3ef0-4350-9fbd-ff5d746c7e21 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.349311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb84fbea-3ef0-4350-9fbd-ff5d746c7e21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.385772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.495324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84fbea-3ef0-4350-9fbd-ff5d746c7e21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.497120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb84fbea-3ef0-4350-9fbd-ff5d746c7e21 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.499248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1046b1-2ae1-43fc-b8c5-a11ce392b76a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.539567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd4bc-a8ad-4773-a596-363b91bd86e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.540571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd4bc-a8ad-4773-a596-363b91bd86e6 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.541060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd4bc-a8ad-4773-a596-363b91bd86e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.541573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5bd4bc-a8ad-4773-a596-363b91bd86e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.542531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bd4bc-a8ad-4773-a596-363b91bd86e6 None admin] RBAC: Adding query filter params (role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c, user.id=62419e76eac94a61b44066fc9bade636) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:55.543134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bd4bc-a8ad-4773-a596-363b91bd86e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.544829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5bd4bc-a8ad-4773-a596-363b91bd86e6 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.552092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 91/176] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/role_assignments?user.id=62419e76eac94a61b44066fc9bade636&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:55.553495 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd4bc-a8ad-4773-a596-363b91bd86e6 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.645873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.697695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 86/177] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:55.698925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84fbea-3ef0-4350-9fbd-ff5d746c7e21 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.730581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5bd4bc-a8ad-4773-a596-363b91bd86e6 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.755878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.773296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2838de50-39ff-4511-83cf-f262cb543feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.774212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838de50-39ff-4511-83cf-f262cb543feb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.774667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838de50-39ff-4511-83cf-f262cb543feb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.775096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838de50-39ff-4511-83cf-f262cb543feb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.786404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2838de50-39ff-4511-83cf-f262cb543feb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-2838de50-39ff-4511-83cf-f262cb543feb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:55.791972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:55.792864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:34:55.793677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 92/178] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:55.794330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a186af-7885-4379-9405-a5868e4a2e9f None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.794543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a186af-7885-4379-9405-a5868e4a2e9f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.794975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a186af-7885-4379-9405-a5868e4a2e9f None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.801503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 93/179] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:55.803019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7e437-12fc-4077-b054-327dc2c5d7d1 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.803462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7e437-12fc-4077-b054-327dc2c5d7d1 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.803876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f7e437-12fc-4077-b054-327dc2c5d7d1 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.805570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 94/180] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:55.806450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7e437-12fc-4077-b054-327dc2c5d7d1 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:55.814240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb84fbea-3ef0-4350-9fbd-ff5d746c7e21 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.850981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c7583-aeda-4b2a-896b-a7636c95f1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.851603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c7583-aeda-4b2a-896b-a7636c95f1cd None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.851888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c7583-aeda-4b2a-896b-a7636c95f1cd None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.852161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c7583-aeda-4b2a-896b-a7636c95f1cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.937982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c7583-aeda-4b2a-896b-a7636c95f1cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.939436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c7583-aeda-4b2a-896b-a7636c95f1cd None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.942728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f7e437-12fc-4077-b054-327dc2c5d7d1 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:55.945344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.984676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beba9cf2-22eb-441d-b0af-bfe1f6467dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:55.985340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba9cf2-22eb-441d-b0af-bfe1f6467dc0 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.985876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba9cf2-22eb-441d-b0af-bfe1f6467dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.985982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba9cf2-22eb-441d-b0af-bfe1f6467dc0 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:55.987016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba9cf2-22eb-441d-b0af-bfe1f6467dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:55.988468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beba9cf2-22eb-441d-b0af-bfe1f6467dc0 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:55.990287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 95/181] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:55.991124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:55.996338 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aee0ba-f546-4c8c-8641-b50b377dadf7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:55.996688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aee0ba-f546-4c8c-8641-b50b377dadf7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:55.996894 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aee0ba-f546-4c8c-8641-b50b377dadf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.014619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-21aee0ba-f546-4c8c-8641-b50b377dadf7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:56.015823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-21aee0ba-f546-4c8c-8641-b50b377dadf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:56.046202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 87/182] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:56.047044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c7583-aeda-4b2a-896b-a7636c95f1cd None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.082639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 96/183] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:56.083877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c17ca-fecb-4c28-96f6-3ba16d90aa18 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.084160 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c17ca-fecb-4c28-96f6-3ba16d90aa18 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.084433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c17ca-fecb-4c28-96f6-3ba16d90aa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.110476 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-609c17ca-fecb-4c28-96f6-3ba16d90aa18 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:56.111959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-609c17ca-fecb-4c28-96f6-3ba16d90aa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:56.149764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c7583-aeda-4b2a-896b-a7636c95f1cd None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.180860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 97/184] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:56.181947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c17ca-fecb-4c28-96f6-3ba16d90aa18 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.192442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48aab35-99cd-41f0-b7bb-75441746c8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.193415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aab35-99cd-41f0-b7bb-75441746c8c9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.193912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aab35-99cd-41f0-b7bb-75441746c8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.194379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48aab35-99cd-41f0-b7bb-75441746c8c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.195248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48aab35-99cd-41f0-b7bb-75441746c8c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:56.196000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48aab35-99cd-41f0-b7bb-75441746c8c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.198429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48aab35-99cd-41f0-b7bb-75441746c8c9 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.208515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 88/185] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.210204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc616d5-6e4c-40b4-9d42-49eaacb9a8b7 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.210688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc616d5-6e4c-40b4-9d42-49eaacb9a8b7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.211157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc616d5-6e4c-40b4-9d42-49eaacb9a8b7 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.212683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.214582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 89/186] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:34:56.220234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc616d5-6e4c-40b4-9d42-49eaacb9a8b7 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.237905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.294120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c17ca-fecb-4c28-96f6-3ba16d90aa18 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.337713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bfb50-6b25-4594-97a4-8063ce3d0075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.339527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bfb50-6b25-4594-97a4-8063ce3d0075 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.340040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bfb50-6b25-4594-97a4-8063ce3d0075 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.340509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4bfb50-6b25-4594-97a4-8063ce3d0075 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.341460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bfb50-6b25-4594-97a4-8063ce3d0075 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c, user.id=50b388ebd083407da9c5b53df1e1692d) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:56.342044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bfb50-6b25-4594-97a4-8063ce3d0075 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.342238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc616d5-6e4c-40b4-9d42-49eaacb9a8b7 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.345684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4bfb50-6b25-4594-97a4-8063ce3d0075 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.361446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 98/187] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/role_assignments?user.id=50b388ebd083407da9c5b53df1e1692d&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.361446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bfb50-6b25-4594-97a4-8063ce3d0075 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.393186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d75956-1f07-44fc-9962-0bf2e0c0288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.394288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d75956-1f07-44fc-9962-0bf2e0c0288e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.395120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d75956-1f07-44fc-9962-0bf2e0c0288e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.395474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d75956-1f07-44fc-9962-0bf2e0c0288e None admin] PATH_INFO: `/v3/projects/0724cd133fb748b58b6389d4ddb3478a` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.397167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d75956-1f07-44fc-9962-0bf2e0c0288e None admin] RBAC: Authorizing `identity:get_project(project_id=0724cd133fb748b58b6389d4ddb3478a)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.398861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d75956-1f07-44fc-9962-0bf2e0c0288e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.400832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 90/188] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/projects/0724cd133fb748b58b6389d4ddb3478a => generated 312 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.403506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a9e8a-0c3d-4d75-9d03-6ccf676275fd None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.403877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a9e8a-0c3d-4d75-9d03-6ccf676275fd None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.404228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677a9e8a-0c3d-4d75-9d03-6ccf676275fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.431214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-677a9e8a-0c3d-4d75-9d03-6ccf676275fd None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:34:56.432927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-677a9e8a-0c3d-4d75-9d03-6ccf676275fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:34:56.483259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.491120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4bfb50-6b25-4594-97a4-8063ce3d0075 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.517650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 91/189] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:34:56.517650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a9e8a-0c3d-4d75-9d03-6ccf676275fd None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.533155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.547921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722bfe-49a4-42ca-9199-3daf3ef141d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.548575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722bfe-49a4-42ca-9199-3daf3ef141d7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.548854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722bfe-49a4-42ca-9199-3daf3ef141d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.549135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8722bfe-49a4-42ca-9199-3daf3ef141d7 None admin] PATH_INFO: `/v3/users/bb51a5086fdf4ef89bc5164359f8bb06` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.565620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8722bfe-49a4-42ca-9199-3daf3ef141d7 None admin] RBAC: Authorizing `identity:get_user(user_id=bb51a5086fdf4ef89bc5164359f8bb06)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.568253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8722bfe-49a4-42ca-9199-3daf3ef141d7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.570277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 99/190] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/users/bb51a5086fdf4ef89bc5164359f8bb06 => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.571092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722bfe-49a4-42ca-9199-3daf3ef141d7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.654901 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677a9e8a-0c3d-4d75-9d03-6ccf676275fd None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.694839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8722bfe-49a4-42ca-9199-3daf3ef141d7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.697982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33b1ec-b606-4e4b-8aee-3b594c9e2ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.698617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33b1ec-b606-4e4b-8aee-3b594c9e2ee0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.698898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33b1ec-b606-4e4b-8aee-3b594c9e2ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.699172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f33b1ec-b606-4e4b-8aee-3b594c9e2ee0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.710534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f33b1ec-b606-4e4b-8aee-3b594c9e2ee0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-2f33b1ec-b606-4e4b-8aee-3b594c9e2ee0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:56.715618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:56.716451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:56.717226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 92/191] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:56.718854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33b1ec-b606-4e4b-8aee-3b594c9e2ee0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.736546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8e398-64b9-4fcb-a45d-14b774272b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.737098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8e398-64b9-4fcb-a45d-14b774272b75 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.737376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8e398-64b9-4fcb-a45d-14b774272b75 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.737692 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8e398-64b9-4fcb-a45d-14b774272b75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.738423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8e398-64b9-4fcb-a45d-14b774272b75 None admin] RBAC: Adding query filter params (role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=0724cd133fb748b58b6389d4ddb3478a, user.id=62419e76eac94a61b44066fc9bade636) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:56.738730 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8e398-64b9-4fcb-a45d-14b774272b75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:56.740182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8e398-64b9-4fcb-a45d-14b774272b75 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:56.746294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 100/192] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/role_assignments?user.id=62419e76eac94a61b44066fc9bade636&scope.project.id=0724cd133fb748b58b6389d4ddb3478a&role.id=165f39c0a24042fdacc0121c96347bcd => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:56.754466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8e398-64b9-4fcb-a45d-14b774272b75 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.785689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.798737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:56.839041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f33b1ec-b606-4e4b-8aee-3b594c9e2ee0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.877284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48c0c8-c791-4b62-a84a-53ab86acb94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.877991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48c0c8-c791-4b62-a84a-53ab86acb94c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.878271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48c0c8-c791-4b62-a84a-53ab86acb94c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.878547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48c0c8-c791-4b62-a84a-53ab86acb94c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:56.881656 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8e398-64b9-4fcb-a45d-14b774272b75 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:56.890828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48c0c8-c791-4b62-a84a-53ab86acb94c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-4f48c0c8-c791-4b62-a84a-53ab86acb94c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:34:56.895848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:34:56.896793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:34:56.897628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 93/193] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:34:56.898302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48c0c8-c791-4b62-a84a-53ab86acb94c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:56.921750 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf0a1e-9d9f-4f0b-8066-ca876573abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:56.922430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf0a1e-9d9f-4f0b-8066-ca876573abe3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:56.922751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf0a1e-9d9f-4f0b-8066-ca876573abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:56.923025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf0a1e-9d9f-4f0b-8066-ca876573abe3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.006715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf0a1e-9d9f-4f0b-8066-ca876573abe3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.008201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf0a1e-9d9f-4f0b-8066-ca876573abe3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.018016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48c0c8-c791-4b62-a84a-53ab86acb94c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.026050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.048500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.059252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2c0bb-056c-40cf-85a1-26bbeb7afd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.059860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2c0bb-056c-40cf-85a1-26bbeb7afd16 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.060549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2c0bb-056c-40cf-85a1-26bbeb7afd16 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.060836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f2c0bb-056c-40cf-85a1-26bbeb7afd16 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.061542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2c0bb-056c-40cf-85a1-26bbeb7afd16 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:57.061851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2c0bb-056c-40cf-85a1-26bbeb7afd16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.063251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f2c0bb-056c-40cf-85a1-26bbeb7afd16 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.071167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 94/194] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.072030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2c0bb-056c-40cf-85a1-26bbeb7afd16 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.111525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 101/195] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:57.112588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf0a1e-9d9f-4f0b-8066-ca876573abe3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.169571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f2c0bb-056c-40cf-85a1-26bbeb7afd16 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.203451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e79d-a287-4ca4-999d-51e7075274e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.204082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e79d-a287-4ca4-999d-51e7075274e2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.204362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e79d-a287-4ca4-999d-51e7075274e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.204638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af6e79d-a287-4ca4-999d-51e7075274e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.205779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6e79d-a287-4ca4-999d-51e7075274e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.207258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af6e79d-a287-4ca4-999d-51e7075274e2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.208827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 95/196] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.209662 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e79d-a287-4ca4-999d-51e7075274e2 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.211681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf0a1e-9d9f-4f0b-8066-ca876573abe3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.229445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.248286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71a821-7c1c-4a23-a8d0-f685e59bd28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.251229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71a821-7c1c-4a23-a8d0-f685e59bd28c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.251504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71a821-7c1c-4a23-a8d0-f685e59bd28c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.251781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71a821-7c1c-4a23-a8d0-f685e59bd28c None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.252510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71a821-7c1c-4a23-a8d0-f685e59bd28c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:57.252807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71a821-7c1c-4a23-a8d0-f685e59bd28c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.254223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b71a821-7c1c-4a23-a8d0-f685e59bd28c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.265681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 102/197] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.268818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71a821-7c1c-4a23-a8d0-f685e59bd28c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.273971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.317002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af6e79d-a287-4ca4-999d-51e7075274e2 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.350261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39de37e-4796-4ebd-8bef-31a34439eeaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.350885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de37e-4796-4ebd-8bef-31a34439eeaa None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.351165 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de37e-4796-4ebd-8bef-31a34439eeaa None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.351435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39de37e-4796-4ebd-8bef-31a34439eeaa None admin] PATH_INFO: `/v3/users/12b9f20a52fa41c084459334e2e76384` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.352688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39de37e-4796-4ebd-8bef-31a34439eeaa None admin] RBAC: Authorizing `identity:get_user(user_id=12b9f20a52fa41c084459334e2e76384)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.354435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39de37e-4796-4ebd-8bef-31a34439eeaa None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.356032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 96/198] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/users/12b9f20a52fa41c084459334e2e76384 => generated 289 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.356770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39de37e-4796-4ebd-8bef-31a34439eeaa None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.367497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b71a821-7c1c-4a23-a8d0-f685e59bd28c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.399498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06b68c-ae9c-4780-b812-54f49a7c64e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.400117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06b68c-ae9c-4780-b812-54f49a7c64e0 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.400397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06b68c-ae9c-4780-b812-54f49a7c64e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.400668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06b68c-ae9c-4780-b812-54f49a7c64e0 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.401798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06b68c-ae9c-4780-b812-54f49a7c64e0 None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.403231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06b68c-ae9c-4780-b812-54f49a7c64e0 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.409845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 103/199] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.409845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06b68c-ae9c-4780-b812-54f49a7c64e0 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.453354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.461084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39de37e-4796-4ebd-8bef-31a34439eeaa None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.483452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.495043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39e729-42fa-4092-b50f-00014b54333f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.495843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39e729-42fa-4092-b50f-00014b54333f None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.496120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39e729-42fa-4092-b50f-00014b54333f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.496394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f39e729-42fa-4092-b50f-00014b54333f None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.497049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39e729-42fa-4092-b50f-00014b54333f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.498520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f39e729-42fa-4092-b50f-00014b54333f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.503249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06b68c-ae9c-4780-b812-54f49a7c64e0 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.520136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 97/200] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:34:57 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:34:57.527079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39e729-42fa-4092-b50f-00014b54333f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.540213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd395c-0b8e-4e2f-b165-9945cbc1f8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.540887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd395c-0b8e-4e2f-b165-9945cbc1f8ea None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.541343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd395c-0b8e-4e2f-b165-9945cbc1f8ea None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.541841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dd395c-0b8e-4e2f-b165-9945cbc1f8ea None admin] PATH_INFO: `/v3/users/bb51a5086fdf4ef89bc5164359f8bb06` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.543327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd395c-0b8e-4e2f-b165-9945cbc1f8ea None admin] RBAC: Authorizing `identity:get_user(user_id=bb51a5086fdf4ef89bc5164359f8bb06)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.544829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dd395c-0b8e-4e2f-b165-9945cbc1f8ea None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.546581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 104/201] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/users/bb51a5086fdf4ef89bc5164359f8bb06 => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.552655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd395c-0b8e-4e2f-b165-9945cbc1f8ea None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.654861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f39e729-42fa-4092-b50f-00014b54333f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.677366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dd395c-0b8e-4e2f-b165-9945cbc1f8ea None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.692498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f09f8-28b9-4c41-8514-58fc9ac51cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.693124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f09f8-28b9-4c41-8514-58fc9ac51cd1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.693431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f09f8-28b9-4c41-8514-58fc9ac51cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.693705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f09f8-28b9-4c41-8514-58fc9ac51cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.695411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.719992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56659716-78c3-4446-804d-d908e3e729a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.720600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56659716-78c3-4446-804d-d908e3e729a2 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.720878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56659716-78c3-4446-804d-d908e3e729a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.721149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56659716-78c3-4446-804d-d908e3e729a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.722045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56659716-78c3-4446-804d-d908e3e729a2 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=aa0906069f964316869e9e61168bf8ac, user.id=bb51a5086fdf4ef89bc5164359f8bb06) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:57.722349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56659716-78c3-4446-804d-d908e3e729a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.723797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56659716-78c3-4446-804d-d908e3e729a2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.729546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 105/202] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/role_assignments?user.id=bb51a5086fdf4ef89bc5164359f8bb06&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:57.730363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56659716-78c3-4446-804d-d908e3e729a2 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.751733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:57.783143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f09f8-28b9-4c41-8514-58fc9ac51cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:57.784673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f09f8-28b9-4c41-8514-58fc9ac51cd1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:57.867048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56659716-78c3-4446-804d-d908e3e729a2 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:57.916867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b3f8-eed8-4770-acfd-b46364f2c15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:57.917567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b3f8-eed8-4770-acfd-b46364f2c15c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:57.917886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b3f8-eed8-4770-acfd-b46364f2c15c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:57.919207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a897b3f8-eed8-4770-acfd-b46364f2c15c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:57.928403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 98/203] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:57.935534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f09f8-28b9-4c41-8514-58fc9ac51cd1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:57.993428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:58.030549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897b3f8-eed8-4770-acfd-b46364f2c15c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:58.038026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a897b3f8-eed8-4770-acfd-b46364f2c15c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:58.061839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:58.065593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f09f8-28b9-4c41-8514-58fc9ac51cd1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:58.109446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e4657-132c-4d0d-b01f-f5d3ba7d19b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:58.109446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e4657-132c-4d0d-b01f-f5d3ba7d19b4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:58.109446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e4657-132c-4d0d-b01f-f5d3ba7d19b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:58.109446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e4657-132c-4d0d-b01f-f5d3ba7d19b4 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:58.110405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e4657-132c-4d0d-b01f-f5d3ba7d19b4 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:58.110405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e4657-132c-4d0d-b01f-f5d3ba7d19b4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:58.110405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 99/204] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:58.117343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e4657-132c-4d0d-b01f-f5d3ba7d19b4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:58.224394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e4657-132c-4d0d-b01f-f5d3ba7d19b4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:58.244093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 106/205] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:34:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:34:58.249978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b3f8-eed8-4770-acfd-b46364f2c15c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:58.275688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec49639-eb2c-4d65-8382-bcfffed04e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:58.276315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec49639-eb2c-4d65-8382-bcfffed04e04 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:58.276564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec49639-eb2c-4d65-8382-bcfffed04e04 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:58.276824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec49639-eb2c-4d65-8382-bcfffed04e04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:58.277589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec49639-eb2c-4d65-8382-bcfffed04e04 None admin] RBAC: Adding query filter params (role.id=f7cd8cb4f15b496e933c06d4f359a934, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c, user.id=12b9f20a52fa41c084459334e2e76384) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:58.277900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec49639-eb2c-4d65-8382-bcfffed04e04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:58.279334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec49639-eb2c-4d65-8382-bcfffed04e04 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:58.294384 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 100/206] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:58 2022] GET /identity/v3/role_assignments?user.id=12b9f20a52fa41c084459334e2e76384&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=f7cd8cb4f15b496e933c06d4f359a934 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:58.355472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:58.379579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a897b3f8-eed8-4770-acfd-b46364f2c15c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:58.417144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef7950-52ae-4646-95b4-3c787ef2cef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:58.417843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef7950-52ae-4646-95b4-3c787ef2cef5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:58.418627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef7950-52ae-4646-95b4-3c787ef2cef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:58.418627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef7950-52ae-4646-95b4-3c787ef2cef5 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:58.419550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef7950-52ae-4646-95b4-3c787ef2cef5 None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:58.421030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfef7950-52ae-4646-95b4-3c787ef2cef5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:58.422925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 107/207] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:34:58 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:34:58.430608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec49639-eb2c-4d65-8382-bcfffed04e04 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:34:58.458422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:34:58.564955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec49639-eb2c-4d65-8382-bcfffed04e04 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:34:58.604676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de10d3c0-fbae-49c0-a8c1-d57ffa5e02f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:34:58.605659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d3c0-fbae-49c0-a8c1-d57ffa5e02f0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:58.606133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d3c0-fbae-49c0-a8c1-d57ffa5e02f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:58.606595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10d3c0-fbae-49c0-a8c1-d57ffa5e02f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:58.607518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10d3c0-fbae-49c0-a8c1-d57ffa5e02f0 None admin] RBAC: Adding query filter params (role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=aa0906069f964316869e9e61168bf8ac, user.id=bb51a5086fdf4ef89bc5164359f8bb06) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:34:58.608053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10d3c0-fbae-49c0-a8c1-d57ffa5e02f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:34:58.610019 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de10d3c0-fbae-49c0-a8c1-d57ffa5e02f0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:34:58.617152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 101/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:34:58 2022] GET /identity/v3/role_assignments?user.id=bb51a5086fdf4ef89bc5164359f8bb06&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:34:59.992951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440c89-09bb-4fcb-bae1-ba47304c2d4e None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:34:59.993549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440c89-09bb-4fcb-bae1-ba47304c2d4e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:34:59.993549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5440c89-09bb-4fcb-bae1-ba47304c2d4e None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:34:59.994851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 108/209] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:00.001248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba28450-3043-49ef-84b6-e44f5e584c8b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.001790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba28450-3043-49ef-84b6-e44f5e584c8b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.001863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba28450-3043-49ef-84b6-e44f5e584c8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.020606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8ba28450-3043-49ef-84b6-e44f5e584c8b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:00.021815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8ba28450-3043-49ef-84b6-e44f5e584c8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:00.090855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 102/210] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:34:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:00.093428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611abfc9-ffbb-4bb1-85ce-30a2941338cd None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.093757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611abfc9-ffbb-4bb1-85ce-30a2941338cd None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.093999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611abfc9-ffbb-4bb1-85ce-30a2941338cd None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.096103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 109/211] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:00.101214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027ecef-bbd9-4c82-ab21-59bc83929a34 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.101537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027ecef-bbd9-4c82-ab21-59bc83929a34 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.101810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027ecef-bbd9-4c82-ab21-59bc83929a34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.117929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.124320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7027ecef-bbd9-4c82-ab21-59bc83929a34 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:00.126316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7027ecef-bbd9-4c82-ab21-59bc83929a34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:00.198871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 103/212] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:00.276502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349caa21-2e9c-4b1d-b354-07d1ae6c7476 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.276806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349caa21-2e9c-4b1d-b354-07d1ae6c7476 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.277062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349caa21-2e9c-4b1d-b354-07d1ae6c7476 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.278450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 110/213] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:00.283744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559fe41-a9d0-4c37-a6fc-fff206dde900 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.284031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559fe41-a9d0-4c37-a6fc-fff206dde900 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.284309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559fe41-a9d0-4c37-a6fc-fff206dde900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.303052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6559fe41-a9d0-4c37-a6fc-fff206dde900 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:00.304238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6559fe41-a9d0-4c37-a6fc-fff206dde900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:00.361088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349caa21-2e9c-4b1d-b354-07d1ae6c7476 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.379858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 104/214] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:00.469957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349caa21-2e9c-4b1d-b354-07d1ae6c7476 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.500443 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559fe41-a9d0-4c37-a6fc-fff206dde900 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.505636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce64bc8-02f2-43b9-9817-8d878c524f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.506438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce64bc8-02f2-43b9-9817-8d878c524f00 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.506853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce64bc8-02f2-43b9-9817-8d878c524f00 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.507285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce64bc8-02f2-43b9-9817-8d878c524f00 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.521183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce64bc8-02f2-43b9-9817-8d878c524f00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-4ce64bc8-02f2-43b9-9817-8d878c524f00 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:00.527652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:00.528701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:00.529698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:00.532662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 111/215] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:00.541427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce64bc8-02f2-43b9-9817-8d878c524f00 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.549169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.581289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.621436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6559fe41-a9d0-4c37-a6fc-fff206dde900 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.645177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce64bc8-02f2-43b9-9817-8d878c524f00 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.658759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b975b-2962-4987-8289-146b60998d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.659634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b975b-2962-4987-8289-146b60998d52 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.660014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b975b-2962-4987-8289-146b60998d52 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.660490 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b975b-2962-4987-8289-146b60998d52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.673247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b975b-2962-4987-8289-146b60998d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-944b975b-2962-4987-8289-146b60998d52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:00.678500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:00.679438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:00.680222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 105/216] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:00.680846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b975b-2962-4987-8289-146b60998d52 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.683498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4e14-e008-4b31-8a06-46cd5063bc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.684354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4e14-e008-4b31-8a06-46cd5063bc8d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.684757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4e14-e008-4b31-8a06-46cd5063bc8d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.685032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cc4e14-e008-4b31-8a06-46cd5063bc8d None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.685736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc4e14-e008-4b31-8a06-46cd5063bc8d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:00.686037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc4e14-e008-4b31-8a06-46cd5063bc8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:00.687436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cc4e14-e008-4b31-8a06-46cd5063bc8d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:00.696632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 112/217] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:00.697522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4e14-e008-4b31-8a06-46cd5063bc8d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.775803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.797108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b975b-2962-4987-8289-146b60998d52 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.808335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cc4e14-e008-4b31-8a06-46cd5063bc8d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.827676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:00.839170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df2ae5-963d-4c4f-93a1-9a6504d515c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.839811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df2ae5-963d-4c4f-93a1-9a6504d515c5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.840089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df2ae5-963d-4c4f-93a1-9a6504d515c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.840361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df2ae5-963d-4c4f-93a1-9a6504d515c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.841522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df2ae5-963d-4c4f-93a1-9a6504d515c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:00.842968 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df2ae5-963d-4c4f-93a1-9a6504d515c5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:00.845087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 106/218] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:00.845087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df2ae5-963d-4c4f-93a1-9a6504d515c5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.853596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29902-d591-4f39-85f7-523e6cce0f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.854224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29902-d591-4f39-85f7-523e6cce0f42 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.854505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29902-d591-4f39-85f7-523e6cce0f42 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.854775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a29902-d591-4f39-85f7-523e6cce0f42 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.855450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a29902-d591-4f39-85f7-523e6cce0f42 None admin] RBAC: Adding query filter params (name=member) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:00.855754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a29902-d591-4f39-85f7-523e6cce0f42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:00.857134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a29902-d591-4f39-85f7-523e6cce0f42 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:00.866183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 113/219] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:00.866941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29902-d591-4f39-85f7-523e6cce0f42 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.946777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df2ae5-963d-4c4f-93a1-9a6504d515c5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.962835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a29902-d591-4f39-85f7-523e6cce0f42 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:00.982760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6aaf20-b221-48c2-88a6-717d8b7ef932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:00.983426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aaf20-b221-48c2-88a6-717d8b7ef932 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.983832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aaf20-b221-48c2-88a6-717d8b7ef932 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.984033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6aaf20-b221-48c2-88a6-717d8b7ef932 None admin] PATH_INFO: `/v3/users/bb51a5086fdf4ef89bc5164359f8bb06` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.985561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aaf20-b221-48c2-88a6-717d8b7ef932 None admin] RBAC: Authorizing `identity:get_user(user_id=bb51a5086fdf4ef89bc5164359f8bb06)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:00.987403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6aaf20-b221-48c2-88a6-717d8b7ef932 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:00.989511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 107/220] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/users/bb51a5086fdf4ef89bc5164359f8bb06 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:00.990834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa074ee-210b-4725-9f0a-ad53918e7e29 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:00.991111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa074ee-210b-4725-9f0a-ad53918e7e29 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:00.991408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa074ee-210b-4725-9f0a-ad53918e7e29 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:00.992601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 108/221] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:00.993295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa074ee-210b-4725-9f0a-ad53918e7e29 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:00.999217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.005345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790a021-9b67-4793-9a4a-895c808291e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.005980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790a021-9b67-4793-9a4a-895c808291e7 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.006259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790a021-9b67-4793-9a4a-895c808291e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.006533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b790a021-9b67-4793-9a4a-895c808291e7 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.007186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790a021-9b67-4793-9a4a-895c808291e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.008621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b790a021-9b67-4793-9a4a-895c808291e7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.029176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 114/222] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:00 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:01.034467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790a021-9b67-4793-9a4a-895c808291e7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.058770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.105419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa074ee-210b-4725-9f0a-ad53918e7e29 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.146643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20660573-4033-4a0c-9aa5-4b6fbd066649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.147296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20660573-4033-4a0c-9aa5-4b6fbd066649 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.147573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20660573-4033-4a0c-9aa5-4b6fbd066649 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.147845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20660573-4033-4a0c-9aa5-4b6fbd066649 None admin] PATH_INFO: `/v3/users/2ad5f5e4db774a57bb3ce0e2f890e886` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.154916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b790a021-9b67-4793-9a4a-895c808291e7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.166320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20660573-4033-4a0c-9aa5-4b6fbd066649 None admin] RBAC: Authorizing `identity:get_user(user_id=2ad5f5e4db774a57bb3ce0e2f890e886)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.167813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20660573-4033-4a0c-9aa5-4b6fbd066649 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.174617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 109/223] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:00 2022] GET /identity/v3/users/2ad5f5e4db774a57bb3ce0e2f890e886 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:01.174617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2770739-c00d-470c-b1b8-f167571b11fd None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.174617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2770739-c00d-470c-b1b8-f167571b11fd None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.174617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2770739-c00d-470c-b1b8-f167571b11fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.191111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b2770739-c00d-470c-b1b8-f167571b11fd None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:01.192338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b2770739-c00d-470c-b1b8-f167571b11fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:01.200231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e03c4-2a4a-4fc3-94d7-2e819fa38d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.200942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e03c4-2a4a-4fc3-94d7-2e819fa38d87 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.201277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e03c4-2a4a-4fc3-94d7-2e819fa38d87 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.201586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9e03c4-2a4a-4fc3-94d7-2e819fa38d87 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.202794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e03c4-2a4a-4fc3-94d7-2e819fa38d87 None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.204783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9e03c4-2a4a-4fc3-94d7-2e819fa38d87 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.211018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 115/224] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:01.211018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e03c4-2a4a-4fc3-94d7-2e819fa38d87 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.275469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.282227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 110/225] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:01.283324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2770739-c00d-470c-b1b8-f167571b11fd None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.337125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9e03c4-2a4a-4fc3-94d7-2e819fa38d87 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.346981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.378582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3b57-78ac-482c-b90a-cbb27f120c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.379329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3b57-78ac-482c-b90a-cbb27f120c28 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.379607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3b57-78ac-482c-b90a-cbb27f120c28 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.379879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a3b57-78ac-482c-b90a-cbb27f120c28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.420663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2770739-c00d-470c-b1b8-f167571b11fd None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.460699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478843af-df48-413e-96fe-26bc44e52436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.461373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478843af-df48-413e-96fe-26bc44e52436 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.461688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478843af-df48-413e-96fe-26bc44e52436 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.461972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478843af-df48-413e-96fe-26bc44e52436 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac/users/bb51a5086fdf4ef89bc5164359f8bb06/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.464341 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478843af-df48-413e-96fe-26bc44e52436 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa0906069f964316869e9e61168bf8ac, user_id=bb51a5086fdf4ef89bc5164359f8bb06, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.465827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478843af-df48-413e-96fe-26bc44e52436 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.466519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a3b57-78ac-482c-b90a-cbb27f120c28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.468321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a3b57-78ac-482c-b90a-cbb27f120c28 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.482677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 111/226] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:01 2022] PUT /identity/v3/projects/aa0906069f964316869e9e61168bf8ac/users/bb51a5086fdf4ef89bc5164359f8bb06/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:01.539638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.592954 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 116/227] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:01.602620 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478843af-df48-413e-96fe-26bc44e52436 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.602810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3b57-78ac-482c-b90a-cbb27f120c28 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.732013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a3b57-78ac-482c-b90a-cbb27f120c28 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.766076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478843af-df48-413e-96fe-26bc44e52436 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:01.779598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b84eb-c7f9-4174-904d-0ed74c95f92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.780242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b84eb-c7f9-4174-904d-0ed74c95f92a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.780521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b84eb-c7f9-4174-904d-0ed74c95f92a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.780792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b84eb-c7f9-4174-904d-0ed74c95f92a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.781806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.802354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b84eb-c7f9-4174-904d-0ed74c95f92a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-de0b84eb-c7f9-4174-904d-0ed74c95f92a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:01.807431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:01.808309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:01.809223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 117/228] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:01.815294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b84eb-c7f9-4174-904d-0ed74c95f92a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.816625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b3c48-3d5d-46ad-9e7a-84b86ba3adb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:01.817334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3c48-3d5d-46ad-9e7a-84b86ba3adb4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:01.817654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3c48-3d5d-46ad-9e7a-84b86ba3adb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:01.817930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b3c48-3d5d-46ad-9e7a-84b86ba3adb4 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:01.819238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b3c48-3d5d-46ad-9e7a-84b86ba3adb4 None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:01.820816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754b3c48-3d5d-46ad-9e7a-84b86ba3adb4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:01.829999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 112/229] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:01.835324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:01.836430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b3c48-3d5d-46ad-9e7a-84b86ba3adb4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:01.987758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b84eb-c7f9-4174-904d-0ed74c95f92a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:02.010125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b3c48-3d5d-46ad-9e7a-84b86ba3adb4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:02.040460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cfbc2-31c9-45d4-b1c2-1c7da708449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:02.041097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cfbc2-31c9-45d4-b1c2-1c7da708449f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:02.041348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cfbc2-31c9-45d4-b1c2-1c7da708449f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:02.041647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32cfbc2-31c9-45d4-b1c2-1c7da708449f None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:02.042316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cfbc2-31c9-45d4-b1c2-1c7da708449f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:02.042620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cfbc2-31c9-45d4-b1c2-1c7da708449f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:02.044072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32cfbc2-31c9-45d4-b1c2-1c7da708449f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:02.053153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 118/230] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:02.058209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cfbc2-31c9-45d4-b1c2-1c7da708449f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:02.086669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf568396-56b7-40f3-a6d3-77ba41e21fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:02.087291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf568396-56b7-40f3-a6d3-77ba41e21fbe None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:02.087568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf568396-56b7-40f3-a6d3-77ba41e21fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:02.087839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf568396-56b7-40f3-a6d3-77ba41e21fbe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:02.088848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf568396-56b7-40f3-a6d3-77ba41e21fbe None admin] RBAC: Adding query filter params (role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=aa0906069f964316869e9e61168bf8ac, user.id=2ad5f5e4db774a57bb3ce0e2f890e886) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:02.089154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf568396-56b7-40f3-a6d3-77ba41e21fbe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:02.090623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf568396-56b7-40f3-a6d3-77ba41e21fbe None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:02.104778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 113/231] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:01 2022] GET /identity/v3/role_assignments?user.id=2ad5f5e4db774a57bb3ce0e2f890e886&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=165f39c0a24042fdacc0121c96347bcd => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:02.145835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:02.171361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32cfbc2-31c9-45d4-b1c2-1c7da708449f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:02.208426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1b0f8-c346-49a2-8eb7-3919c61b9b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:02.209260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b0f8-c346-49a2-8eb7-3919c61b9b16 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:02.209661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b0f8-c346-49a2-8eb7-3919c61b9b16 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:02.210064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b1b0f8-c346-49a2-8eb7-3919c61b9b16 None admin] PATH_INFO: `/v3/users/bb51a5086fdf4ef89bc5164359f8bb06` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:02.211486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1b0f8-c346-49a2-8eb7-3919c61b9b16 None admin] RBAC: Authorizing `identity:get_user(user_id=bb51a5086fdf4ef89bc5164359f8bb06)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:02.213448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b1b0f8-c346-49a2-8eb7-3919c61b9b16 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:02.215682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 119/232] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:02 2022] GET /identity/v3/users/bb51a5086fdf4ef89bc5164359f8bb06 => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:02.221882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf568396-56b7-40f3-a6d3-77ba41e21fbe None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:02.294780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:02.367527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf568396-56b7-40f3-a6d3-77ba41e21fbe None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:02.410792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc099a6-1974-4ae8-a969-10c7e33182b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:02.411452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc099a6-1974-4ae8-a969-10c7e33182b7 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:02.411731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc099a6-1974-4ae8-a969-10c7e33182b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:02.412004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc099a6-1974-4ae8-a969-10c7e33182b7 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:02.417182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc099a6-1974-4ae8-a969-10c7e33182b7 None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:02.418722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc099a6-1974-4ae8-a969-10c7e33182b7 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:02.420886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 114/233] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:02 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:02.432550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1b0f8-c346-49a2-8eb7-3919c61b9b16 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:02.598215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b1b0f8-c346-49a2-8eb7-3919c61b9b16 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:02.638119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87aab5f-bce3-4f3a-a4cd-183e784e8feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:02.638849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aab5f-bce3-4f3a-a4cd-183e784e8feb None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:02.639137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aab5f-bce3-4f3a-a4cd-183e784e8feb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:02.639414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87aab5f-bce3-4f3a-a4cd-183e784e8feb None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac/users/bb51a5086fdf4ef89bc5164359f8bb06/roles/1f5abd9c8afd411ebac7cd79bb5f1230` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:02.642175 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aab5f-bce3-4f3a-a4cd-183e784e8feb None admin] RBAC: Authorizing `identity:create_grant(project_id=aa0906069f964316869e9e61168bf8ac, user_id=bb51a5086fdf4ef89bc5164359f8bb06, role_id=1f5abd9c8afd411ebac7cd79bb5f1230)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:02.643633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87aab5f-bce3-4f3a-a4cd-183e784e8feb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:02.664810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 120/234] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:02 2022] PUT /identity/v3/projects/aa0906069f964316869e9e61168bf8ac/users/bb51a5086fdf4ef89bc5164359f8bb06/roles/1f5abd9c8afd411ebac7cd79bb5f1230 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:03.676550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b1136-b8e2-497c-a8a3-85497773c219 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.677208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b1136-b8e2-497c-a8a3-85497773c219 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.677208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b1136-b8e2-497c-a8a3-85497773c219 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.678383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 115/235] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:03.683851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5d66-6149-403e-9383-43fd6992cfd8 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:03.684350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5d66-6149-403e-9383-43fd6992cfd8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:03.684518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6f5d66-6149-403e-9383-43fd6992cfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:03.703532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:03.714043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ef6f5d66-6149-403e-9383-43fd6992cfd8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:03.715826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ef6f5d66-6149-403e-9383-43fd6992cfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:03.820975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 121/236] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:04.119218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63a305-c2e2-4d1b-98b8-4058ca42e83c None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.119589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63a305-c2e2-4d1b-98b8-4058ca42e83c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.119772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63a305-c2e2-4d1b-98b8-4058ca42e83c None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.121350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 116/237] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:04.127989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ab403-8f46-429a-bef0-4f36f6878a6b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.128278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ab403-8f46-429a-bef0-4f36f6878a6b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.128559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ab403-8f46-429a-bef0-4f36f6878a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.154419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-bd7ab403-8f46-429a-bef0-4f36f6878a6b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:04.155600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bd7ab403-8f46-429a-bef0-4f36f6878a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:04.245441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 122/238] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:04.284222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63a305-c2e2-4d1b-98b8-4058ca42e83c None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.396355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8200-3cd1-4c44-a243-c4fc1229a8f0 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.396668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8200-3cd1-4c44-a243-c4fc1229a8f0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.396828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48c8200-3cd1-4c44-a243-c4fc1229a8f0 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.398181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 123/239] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:04.410340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414dffd-f16f-4b63-a45c-8214abc43f70 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.410622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414dffd-f16f-4b63-a45c-8214abc43f70 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.410899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414dffd-f16f-4b63-a45c-8214abc43f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.441085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63a305-c2e2-4d1b-98b8-4058ca42e83c None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.444337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-5414dffd-f16f-4b63-a45c-8214abc43f70 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:04.445560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5414dffd-f16f-4b63-a45c-8214abc43f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:04.464119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.508852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75dec1-ebd0-4ca5-a820-fc9324dd364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.509877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75dec1-ebd0-4ca5-a820-fc9324dd364f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.510374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75dec1-ebd0-4ca5-a820-fc9324dd364f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.510858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d75dec1-ebd0-4ca5-a820-fc9324dd364f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.525221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d75dec1-ebd0-4ca5-a820-fc9324dd364f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-1d75dec1-ebd0-4ca5-a820-fc9324dd364f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:04.535188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:04.536141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:04.536908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 117/240] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:04.542751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75dec1-ebd0-4ca5-a820-fc9324dd364f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.569060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.578357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 124/241] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:04.585346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414dffd-f16f-4b63-a45c-8214abc43f70 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.651271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d75dec1-ebd0-4ca5-a820-fc9324dd364f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.688782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf7ca31-93bf-4d43-b00b-23d0aadca268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.689453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ca31-93bf-4d43-b00b-23d0aadca268 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.689702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ca31-93bf-4d43-b00b-23d0aadca268 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.689978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7ca31-93bf-4d43-b00b-23d0aadca268 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.690651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7ca31-93bf-4d43-b00b-23d0aadca268 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:04.690957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7ca31-93bf-4d43-b00b-23d0aadca268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:04.692352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf7ca31-93bf-4d43-b00b-23d0aadca268 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:04.702943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 118/242] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:04.704858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f9150-b292-4141-b69d-6083b4376447 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.705978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f9150-b292-4141-b69d-6083b4376447 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.706270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f9150-b292-4141-b69d-6083b4376447 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.707502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 119/243] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:04.713292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32349-7dfd-4d2a-86f9-7c73c15d3ed0 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.713609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32349-7dfd-4d2a-86f9-7c73c15d3ed0 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.713882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d32349-7dfd-4d2a-86f9-7c73c15d3ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.736175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-20d32349-7dfd-4d2a-86f9-7c73c15d3ed0 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:04.737664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-20d32349-7dfd-4d2a-86f9-7c73c15d3ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:04.739091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414dffd-f16f-4b63-a45c-8214abc43f70 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.769353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.778091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf44e-a3f4-472e-9d28-ee5e50b2230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.779076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf44e-a3f4-472e-9d28-ee5e50b2230d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.779649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf44e-a3f4-472e-9d28-ee5e50b2230d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.780121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2adf44e-a3f4-472e-9d28-ee5e50b2230d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.781432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adf44e-a3f4-472e-9d28-ee5e50b2230d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:04.783106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2adf44e-a3f4-472e-9d28-ee5e50b2230d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:04.785432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 125/244] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:04.786535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf44e-a3f4-472e-9d28-ee5e50b2230d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.833548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 120/245] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:04.836325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d32349-7dfd-4d2a-86f9-7c73c15d3ed0 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:04.879095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:04.942165 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2adf44e-a3f4-472e-9d28-ee5e50b2230d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:04.979601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bbd43-1b1b-4144-98d9-b7fb1606fc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:04.980594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bbd43-1b1b-4144-98d9-b7fb1606fc7e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:04.981121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bbd43-1b1b-4144-98d9-b7fb1606fc7e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:04.981637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bbd43-1b1b-4144-98d9-b7fb1606fc7e None admin] PATH_INFO: `/v3/users/1e7ab09e16d5429fb7b5f83298543220` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:04.997518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d32349-7dfd-4d2a-86f9-7c73c15d3ed0 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.000052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bbd43-1b1b-4144-98d9-b7fb1606fc7e None admin] RBAC: Authorizing `identity:get_user(user_id=1e7ab09e16d5429fb7b5f83298543220)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.001647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bbd43-1b1b-4144-98d9-b7fb1606fc7e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.003612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 126/246] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:04 2022] GET /identity/v3/users/1e7ab09e16d5429fb7b5f83298543220 => generated 297 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:05.004390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bbd43-1b1b-4144-98d9-b7fb1606fc7e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.041749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47008e-1c75-4252-ba7b-53007ed2c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.042372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47008e-1c75-4252-ba7b-53007ed2c180 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.042653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47008e-1c75-4252-ba7b-53007ed2c180 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.042927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc47008e-1c75-4252-ba7b-53007ed2c180 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.043586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47008e-1c75-4252-ba7b-53007ed2c180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.045046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc47008e-1c75-4252-ba7b-53007ed2c180 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.078090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 121/247] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:04 2022] POST /identity/v3/users => generated 293 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:05.080281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47008e-1c75-4252-ba7b-53007ed2c180 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.122654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.137841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bbd43-1b1b-4144-98d9-b7fb1606fc7e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.170092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.187241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c0e53-3be6-4c2e-9dc1-e6c0ab312ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.188640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c0e53-3be6-4c2e-9dc1-e6c0ab312ca4 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.188912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c0e53-3be6-4c2e-9dc1-e6c0ab312ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.189183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c0e53-3be6-4c2e-9dc1-e6c0ab312ca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.201256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c0e53-3be6-4c2e-9dc1-e6c0ab312ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-b13c0e53-3be6-4c2e-9dc1-e6c0ab312ca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:05.206683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:05.207637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 127/248] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:05.209144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c0e53-3be6-4c2e-9dc1-e6c0ab312ca4 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.236272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc47008e-1c75-4252-ba7b-53007ed2c180 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.279409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9340-45c5-41ed-be77-31645217e60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.280032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9340-45c5-41ed-be77-31645217e60f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.280318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9340-45c5-41ed-be77-31645217e60f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.280593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c9340-45c5-41ed-be77-31645217e60f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.350086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c0e53-3be6-4c2e-9dc1-e6c0ab312ca4 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.371992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9340-45c5-41ed-be77-31645217e60f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.373541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c9340-45c5-41ed-be77-31645217e60f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.396544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc20fb-87c3-4b34-b275-62afbac7a055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.397210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc20fb-87c3-4b34-b275-62afbac7a055 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.397539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc20fb-87c3-4b34-b275-62afbac7a055 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.397818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc20fb-87c3-4b34-b275-62afbac7a055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.398021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.418270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbc20fb-87c3-4b34-b275-62afbac7a055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-0cbc20fb-87c3-4b34-b275-62afbac7a055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:05.425971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:05.426878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:05.427650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 128/249] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:05.430233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc20fb-87c3-4b34-b275-62afbac7a055 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.497544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.522371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 122/250] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:05.523381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9340-45c5-41ed-be77-31645217e60f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.575493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc20fb-87c3-4b34-b275-62afbac7a055 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.615249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dace92-8a93-4431-b256-bf38b61af3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.615865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dace92-8a93-4431-b256-bf38b61af3d9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.616148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dace92-8a93-4431-b256-bf38b61af3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.616503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dace92-8a93-4431-b256-bf38b61af3d9 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.617177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dace92-8a93-4431-b256-bf38b61af3d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:05.617511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dace92-8a93-4431-b256-bf38b61af3d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.618901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dace92-8a93-4431-b256-bf38b61af3d9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.628807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 129/251] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:05.630435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740995-ff86-4e31-95f2-7cd1e12e26d2 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.630733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740995-ff86-4e31-95f2-7cd1e12e26d2 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.631010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7740995-ff86-4e31-95f2-7cd1e12e26d2 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.632479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 130/252] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:05.633344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740995-ff86-4e31-95f2-7cd1e12e26d2 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.640619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c9340-45c5-41ed-be77-31645217e60f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.672890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.681978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164a5583-6c9b-43b0-a4cf-34ec46ea7288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.682595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5583-6c9b-43b0-a4cf-34ec46ea7288 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.682873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5583-6c9b-43b0-a4cf-34ec46ea7288 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.683146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164a5583-6c9b-43b0-a4cf-34ec46ea7288 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.683816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a5583-6c9b-43b0-a4cf-34ec46ea7288 None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:05.684117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a5583-6c9b-43b0-a4cf-34ec46ea7288 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.685985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164a5583-6c9b-43b0-a4cf-34ec46ea7288 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.696449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 123/253] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:05.702680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8616fff-4680-4b65-aef2-b0fdfeefa142 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.702965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8616fff-4680-4b65-aef2-b0fdfeefa142 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.703242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8616fff-4680-4b65-aef2-b0fdfeefa142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.728883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c8616fff-4680-4b65-aef2-b0fdfeefa142 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:05.730114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c8616fff-4680-4b65-aef2-b0fdfeefa142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:05.765541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7740995-ff86-4e31-95f2-7cd1e12e26d2 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.770234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:05.815246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feb62d-1bc1-4118-9a53-26cf38c4dceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:05.815946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feb62d-1bc1-4118-9a53-26cf38c4dceb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:05.816645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feb62d-1bc1-4118-9a53-26cf38c4dceb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:05.816941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81feb62d-1bc1-4118-9a53-26cf38c4dceb None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:05.818459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81feb62d-1bc1-4118-9a53-26cf38c4dceb None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:05.820239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81feb62d-1bc1-4118-9a53-26cf38c4dceb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:05.822194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 131/254] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:05.822920 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feb62d-1bc1-4118-9a53-26cf38c4dceb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.823934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 124/255] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:05.825128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8616fff-4680-4b65-aef2-b0fdfeefa142 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:05.971859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8616fff-4680-4b65-aef2-b0fdfeefa142 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:05.983942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.018088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba8518-2a02-4d22-a100-3b01e61477ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.020015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8518-2a02-4d22-a100-3b01e61477ae None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.020728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8518-2a02-4d22-a100-3b01e61477ae None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.021003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ba8518-2a02-4d22-a100-3b01e61477ae None admin] PATH_INFO: `/v3/users/2ad5f5e4db774a57bb3ce0e2f890e886` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.024402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba8518-2a02-4d22-a100-3b01e61477ae None admin] RBAC: Authorizing `identity:get_user(user_id=2ad5f5e4db774a57bb3ce0e2f890e886)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.025890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ba8518-2a02-4d22-a100-3b01e61477ae None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.029328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 125/256] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/users/2ad5f5e4db774a57bb3ce0e2f890e886 => generated 297 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:06.030101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba8518-2a02-4d22-a100-3b01e61477ae None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.049737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81feb62d-1bc1-4118-9a53-26cf38c4dceb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.115377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd0a48-a1c9-4ce9-ac12-7d58e4a1f27c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.116018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd0a48-a1c9-4ce9-ac12-7d58e4a1f27c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.116293 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd0a48-a1c9-4ce9-ac12-7d58e4a1f27c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.116891 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd0a48-a1c9-4ce9-ac12-7d58e4a1f27c None admin] PATH_INFO: `/v3/users/bb51a5086fdf4ef89bc5164359f8bb06` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.120009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd0a48-a1c9-4ce9-ac12-7d58e4a1f27c None admin] RBAC: Authorizing `identity:get_user(user_id=bb51a5086fdf4ef89bc5164359f8bb06)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.121717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd0a48-a1c9-4ce9-ac12-7d58e4a1f27c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.124900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 132/257] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:05 2022] GET /identity/v3/users/bb51a5086fdf4ef89bc5164359f8bb06 => generated 283 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:06.126245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd0a48-a1c9-4ce9-ac12-7d58e4a1f27c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.192264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.194636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ba8518-2a02-4d22-a100-3b01e61477ae None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.233359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98b52-7b40-4610-90d9-ad28a9b00a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.234094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98b52-7b40-4610-90d9-ad28a9b00a28 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.234374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98b52-7b40-4610-90d9-ad28a9b00a28 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.234713 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f98b52-7b40-4610-90d9-ad28a9b00a28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.235525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98b52-7b40-4610-90d9-ad28a9b00a28 None admin] RBAC: Adding query filter params (role.id=f7cd8cb4f15b496e933c06d4f359a934, scope.project.id=aa0906069f964316869e9e61168bf8ac, user.id=1e7ab09e16d5429fb7b5f83298543220) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:06.235875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98b52-7b40-4610-90d9-ad28a9b00a28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.237371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f98b52-7b40-4610-90d9-ad28a9b00a28 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.244652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 126/258] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/role_assignments?user.id=1e7ab09e16d5429fb7b5f83298543220&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=f7cd8cb4f15b496e933c06d4f359a934 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:06.245682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98b52-7b40-4610-90d9-ad28a9b00a28 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.268081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd0a48-a1c9-4ce9-ac12-7d58e4a1f27c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.300867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.315301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e1371-c28a-440e-8e85-3cb31ced730a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.316239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e1371-c28a-440e-8e85-3cb31ced730a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.316609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e1371-c28a-440e-8e85-3cb31ced730a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.317015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70e1371-c28a-440e-8e85-3cb31ced730a None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.319110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e1371-c28a-440e-8e85-3cb31ced730a None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.321191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70e1371-c28a-440e-8e85-3cb31ced730a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.324119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 133/259] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:06.325370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e1371-c28a-440e-8e85-3cb31ced730a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.377612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f98b52-7b40-4610-90d9-ad28a9b00a28 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.465082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59959bf-c73b-464b-999b-124758430076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.465742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59959bf-c73b-464b-999b-124758430076 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.466018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59959bf-c73b-464b-999b-124758430076 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.468685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59959bf-c73b-464b-999b-124758430076 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.472579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70e1371-c28a-440e-8e85-3cb31ced730a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.493012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.531821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00b843-5974-4fe9-8a92-37fdf4a6f057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.532496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00b843-5974-4fe9-8a92-37fdf4a6f057 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.532773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00b843-5974-4fe9-8a92-37fdf4a6f057 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.533046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00b843-5974-4fe9-8a92-37fdf4a6f057 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.543550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00b843-5974-4fe9-8a92-37fdf4a6f057 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-dc00b843-5974-4fe9-8a92-37fdf4a6f057 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:06.549782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:06.550678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:06.551521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 134/260] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:06.552184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00b843-5974-4fe9-8a92-37fdf4a6f057 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.588294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59959bf-c73b-464b-999b-124758430076 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.589790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59959bf-c73b-464b-999b-124758430076 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.660457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.733308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00b843-5974-4fe9-8a92-37fdf4a6f057 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.774556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441eb972-5f3d-480e-a0cc-919d42128c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.775294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441eb972-5f3d-480e-a0cc-919d42128c1d None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.775478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441eb972-5f3d-480e-a0cc-919d42128c1d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.775757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441eb972-5f3d-480e-a0cc-919d42128c1d None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac/users/2ad5f5e4db774a57bb3ce0e2f890e886/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.777819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441eb972-5f3d-480e-a0cc-919d42128c1d None admin] RBAC: Authorizing `identity:create_grant(project_id=aa0906069f964316869e9e61168bf8ac, user_id=2ad5f5e4db774a57bb3ce0e2f890e886, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.778037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 127/261] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:06.779350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59959bf-c73b-464b-999b-124758430076 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.784281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441eb972-5f3d-480e-a0cc-919d42128c1d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.812235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 135/262] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:06 2022] PUT /identity/v3/projects/aa0906069f964316869e9e61168bf8ac/users/2ad5f5e4db774a57bb3ce0e2f890e886/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:06.813685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441eb972-5f3d-480e-a0cc-919d42128c1d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.872478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:06.910377 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59959bf-c73b-464b-999b-124758430076 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:06.951285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1face9-239c-462b-a825-730781707010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:06.952433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1face9-239c-462b-a825-730781707010 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:06.952710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1face9-239c-462b-a825-730781707010 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:06.952981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1face9-239c-462b-a825-730781707010 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:06.954377 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1face9-239c-462b-a825-730781707010 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:06.954680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1face9-239c-462b-a825-730781707010 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:06.956851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1face9-239c-462b-a825-730781707010 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:06.973504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 128/263] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:06.977674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1face9-239c-462b-a825-730781707010 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:06.982963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:07.001790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441eb972-5f3d-480e-a0cc-919d42128c1d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.064500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b77f9-0f0c-4a95-9ecf-389b8e13a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.065182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b77f9-0f0c-4a95-9ecf-389b8e13a567 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.065496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b77f9-0f0c-4a95-9ecf-389b8e13a567 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.065774 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b77f9-0f0c-4a95-9ecf-389b8e13a567 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.066970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b77f9-0f0c-4a95-9ecf-389b8e13a567 None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.068456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155b77f9-0f0c-4a95-9ecf-389b8e13a567 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.079182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 136/264] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:07.086245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b77f9-0f0c-4a95-9ecf-389b8e13a567 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:07.104018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1face9-239c-462b-a825-730781707010 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.150526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ceca-a3de-4a61-b374-b8a6b573b069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.151170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ceca-a3de-4a61-b374-b8a6b573b069 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.151446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ceca-a3de-4a61-b374-b8a6b573b069 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.151716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad3ceca-a3de-4a61-b374-b8a6b573b069 None admin] PATH_INFO: `/v3/users/bb51a5086fdf4ef89bc5164359f8bb06` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.153855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ceca-a3de-4a61-b374-b8a6b573b069 None admin] RBAC: Authorizing `identity:get_user(user_id=bb51a5086fdf4ef89bc5164359f8bb06)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.155295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad3ceca-a3de-4a61-b374-b8a6b573b069 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.157364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 129/265] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:06 2022] GET /identity/v3/users/bb51a5086fdf4ef89bc5164359f8bb06 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:07.162393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ceca-a3de-4a61-b374-b8a6b573b069 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:07.233947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:07.244120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b77f9-0f0c-4a95-9ecf-389b8e13a567 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.279391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:07.315749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad3ceca-a3de-4a61-b374-b8a6b573b069 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.317370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9378698-eef3-48cb-80a1-4272006d9bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.318221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9378698-eef3-48cb-80a1-4272006d9bed None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.318691 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9378698-eef3-48cb-80a1-4272006d9bed None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.319193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9378698-eef3-48cb-80a1-4272006d9bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.320177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9378698-eef3-48cb-80a1-4272006d9bed None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=aa0906069f964316869e9e61168bf8ac, user.id=bb51a5086fdf4ef89bc5164359f8bb06) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:07.320790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9378698-eef3-48cb-80a1-4272006d9bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.322460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9378698-eef3-48cb-80a1-4272006d9bed None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.332869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 137/266] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:07 2022] GET /identity/v3/role_assignments?user.id=bb51a5086fdf4ef89bc5164359f8bb06&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 608 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:07.373577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db141875-4683-47df-93f8-679905a69d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.375063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db141875-4683-47df-93f8-679905a69d02 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.375640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db141875-4683-47df-93f8-679905a69d02 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.376102 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db141875-4683-47df-93f8-679905a69d02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.483058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db141875-4683-47df-93f8-679905a69d02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.484557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db141875-4683-47df-93f8-679905a69d02 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.568842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:07.602112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 130/267] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 00:35:07.607959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9378698-eef3-48cb-80a1-4272006d9bed None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:07.747365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9378698-eef3-48cb-80a1-4272006d9bed None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.793110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce03b54-a43e-4e45-a8bd-528fbf9056d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.794589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce03b54-a43e-4e45-a8bd-528fbf9056d3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.795070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce03b54-a43e-4e45-a8bd-528fbf9056d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.795540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce03b54-a43e-4e45-a8bd-528fbf9056d3 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.796884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce03b54-a43e-4e45-a8bd-528fbf9056d3 None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.799129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce03b54-a43e-4e45-a8bd-528fbf9056d3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.801010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 138/268] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:07 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:07.806928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db141875-4683-47df-93f8-679905a69d02 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:07.935236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db141875-4683-47df-93f8-679905a69d02 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:07.973609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca2fab6-3994-417b-86a3-254fb12b7f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:07.974236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2fab6-3994-417b-86a3-254fb12b7f8d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.974516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2fab6-3994-417b-86a3-254fb12b7f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.974872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca2fab6-3994-417b-86a3-254fb12b7f8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.975556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2fab6-3994-417b-86a3-254fb12b7f8d None admin] RBAC: Adding query filter params (role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=aa0906069f964316869e9e61168bf8ac, user.id=bb51a5086fdf4ef89bc5164359f8bb06) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:07.975857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2fab6-3994-417b-86a3-254fb12b7f8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:07.977346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca2fab6-3994-417b-86a3-254fb12b7f8d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:07.984301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 131/269] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:07 2022] GET /identity/v3/role_assignments?user.id=bb51a5086fdf4ef89bc5164359f8bb06&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:07.990357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2a780-726e-438a-85e1-546cce10031d None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:07.990996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2a780-726e-438a-85e1-546cce10031d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:07.991488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e2a780-726e-438a-85e1-546cce10031d None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:07.993279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 139/270] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:07.999628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d08ce-3240-4c58-b1fc-d8903061955d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.000348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d08ce-3240-4c58-b1fc-d8903061955d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.000826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764d08ce-3240-4c58-b1fc-d8903061955d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.020824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-764d08ce-3240-4c58-b1fc-d8903061955d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:08.022423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-764d08ce-3240-4c58-b1fc-d8903061955d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:08.067081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.101139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb6f5a-0697-4326-ab31-e85331a8250c None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.101483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb6f5a-0697-4326-ab31-e85331a8250c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.101720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb6f5a-0697-4326-ab31-e85331a8250c None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.103334 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 140/271] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:08.119611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012728-06db-4fc6-807c-dd0375ba0192 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.119920 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012728-06db-4fc6-807c-dd0375ba0192 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.120161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66012728-06db-4fc6-807c-dd0375ba0192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.121450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 132/272] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:08.153269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-66012728-06db-4fc6-807c-dd0375ba0192 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:08.158721 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-66012728-06db-4fc6-807c-dd0375ba0192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:08.193082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.258820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 141/273] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:08.417312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d08ce-3240-4c58-b1fc-d8903061955d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.528224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764d08ce-3240-4c58-b1fc-d8903061955d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.548728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012728-06db-4fc6-807c-dd0375ba0192 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.566568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb80e57-e9c3-47a8-8782-690545071b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.567214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb80e57-e9c3-47a8-8782-690545071b05 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.567491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb80e57-e9c3-47a8-8782-690545071b05 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.567761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb80e57-e9c3-47a8-8782-690545071b05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.588562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb80e57-e9c3-47a8-8782-690545071b05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-bfb80e57-e9c3-47a8-8782-690545071b05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:08.593788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:08.594741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:08.595546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 133/274] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:08.602472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb80e57-e9c3-47a8-8782-690545071b05 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.632468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.692957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66012728-06db-4fc6-807c-dd0375ba0192 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.710031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb80e57-e9c3-47a8-8782-690545071b05 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.731910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff7fc-116f-46a5-9762-b8ea5c2f870e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.732551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff7fc-116f-46a5-9762-b8ea5c2f870e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.732927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff7fc-116f-46a5-9762-b8ea5c2f870e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.733194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ff7fc-116f-46a5-9762-b8ea5c2f870e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.734346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ff7fc-116f-46a5-9762-b8ea5c2f870e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:08.736448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ff7fc-116f-46a5-9762-b8ea5c2f870e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:08.738078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 142/275] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:08.743584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff7fc-116f-46a5-9762-b8ea5c2f870e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.751048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da4a78-14c3-4d3c-9570-88f2f99d77e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.751685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da4a78-14c3-4d3c-9570-88f2f99d77e6 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.751959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da4a78-14c3-4d3c-9570-88f2f99d77e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.752227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9da4a78-14c3-4d3c-9570-88f2f99d77e6 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.752895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da4a78-14c3-4d3c-9570-88f2f99d77e6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:08.753295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da4a78-14c3-4d3c-9570-88f2f99d77e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:08.754696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9da4a78-14c3-4d3c-9570-88f2f99d77e6 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:08.763984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 134/276] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:08.774595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da4a78-14c3-4d3c-9570-88f2f99d77e6 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:08.774743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.865573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ff7fc-116f-46a5-9762-b8ea5c2f870e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.876085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:08.892987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9da4a78-14c3-4d3c-9570-88f2f99d77e6 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:08.912537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12526f5-dd32-4c99-a3b1-6a38d032d97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.913490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12526f5-dd32-4c99-a3b1-6a38d032d97c None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.914534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12526f5-dd32-4c99-a3b1-6a38d032d97c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.915010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12526f5-dd32-4c99-a3b1-6a38d032d97c None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.916113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12526f5-dd32-4c99-a3b1-6a38d032d97c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:08.918773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12526f5-dd32-4c99-a3b1-6a38d032d97c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:08.928069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee58894-bad1-4c6b-99f6-6102de006d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:08.928697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee58894-bad1-4c6b-99f6-6102de006d3f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:08.928972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee58894-bad1-4c6b-99f6-6102de006d3f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:08.929241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee58894-bad1-4c6b-99f6-6102de006d3f None admin] PATH_INFO: `/v3/users/0444b02a83bc4760b9c9b44f5114f133` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:08.946082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee58894-bad1-4c6b-99f6-6102de006d3f None admin] RBAC: Authorizing `identity:get_user(user_id=0444b02a83bc4760b9c9b44f5114f133)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:08.947874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee58894-bad1-4c6b-99f6-6102de006d3f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:08.948138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 143/277] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:08 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:35:08.956406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 135/278] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/users/0444b02a83bc4760b9c9b44f5114f133 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:08.958173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12526f5-dd32-4c99-a3b1-6a38d032d97c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:09.053935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:09.074421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12526f5-dd32-4c99-a3b1-6a38d032d97c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:09.114004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da711fd8-41aa-4fc7-8046-f9ad157c34b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:09.114628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da711fd8-41aa-4fc7-8046-f9ad157c34b5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.114909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da711fd8-41aa-4fc7-8046-f9ad157c34b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.115187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da711fd8-41aa-4fc7-8046-f9ad157c34b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.115989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da711fd8-41aa-4fc7-8046-f9ad157c34b5 None admin] RBAC: Adding query filter params (role.id=165f39c0a24042fdacc0121c96347bcd, user.id=0444b02a83bc4760b9c9b44f5114f133, scope.system=all) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:09.116247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da711fd8-41aa-4fc7-8046-f9ad157c34b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:09.117758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da711fd8-41aa-4fc7-8046-f9ad157c34b5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:09.123896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 144/279] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 17 00:35:08 2022] GET /identity/v3/role_assignments?user.id=0444b02a83bc4760b9c9b44f5114f133&scope.system=all&role.id=165f39c0a24042fdacc0121c96347bcd => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:09.306142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42e3a-5128-4a47-9494-c4504bde22d0 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.306425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42e3a-5128-4a47-9494-c4504bde22d0 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.306699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e42e3a-5128-4a47-9494-c4504bde22d0 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.308309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 136/280] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:09.313556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3257413-152a-4a1b-9271-85e03139f374 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.314011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3257413-152a-4a1b-9271-85e03139f374 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.314439 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3257413-152a-4a1b-9271-85e03139f374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.335304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f3257413-152a-4a1b-9271-85e03139f374 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:09.336480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f3257413-152a-4a1b-9271-85e03139f374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:09.411045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 145/281] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:09.681233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42e3a-5128-4a47-9494-c4504bde22d0 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:09.790537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e42e3a-5128-4a47-9494-c4504bde22d0 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:09.798005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08508033-627a-408d-a4f1-095233ce3b35 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.798291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08508033-627a-408d-a4f1-095233ce3b35 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.798566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08508033-627a-408d-a4f1-095233ce3b35 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.800061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 146/282] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:09.805053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3531dfa-dabd-4911-9031-748a21958fe1 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.805335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3531dfa-dabd-4911-9031-748a21958fe1 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.805650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3531dfa-dabd-4911-9031-748a21958fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.828015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f3531dfa-dabd-4911-9031-748a21958fe1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:09.829798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f3531dfa-dabd-4911-9031-748a21958fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:09.847671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c023591-be1f-45bc-a5c7-1c1342a575c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:09.848370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c023591-be1f-45bc-a5c7-1c1342a575c5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:09.848649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c023591-be1f-45bc-a5c7-1c1342a575c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:09.848915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c023591-be1f-45bc-a5c7-1c1342a575c5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:09.870382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c023591-be1f-45bc-a5c7-1c1342a575c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-6c023591-be1f-45bc-a5c7-1c1342a575c5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:09.876014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:09.877288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:09.878097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 137/283] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:09.884234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c023591-be1f-45bc-a5c7-1c1342a575c5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:09.904133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:09.917719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 147/284] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:10.026194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c023591-be1f-45bc-a5c7-1c1342a575c5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:10.072794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6666-c1aa-49f0-81ba-9a8e3b0db86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:10.073435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6666-c1aa-49f0-81ba-9a8e3b0db86b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:10.073715 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6666-c1aa-49f0-81ba-9a8e3b0db86b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:10.073988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbb6666-c1aa-49f0-81ba-9a8e3b0db86b None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:10.074732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb6666-c1aa-49f0-81ba-9a8e3b0db86b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:10.075044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb6666-c1aa-49f0-81ba-9a8e3b0db86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:10.076497 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbb6666-c1aa-49f0-81ba-9a8e3b0db86b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:10.089374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 138/285] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:10.095030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3531dfa-dabd-4911-9031-748a21958fe1 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:10.103751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:10.215265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3531dfa-dabd-4911-9031-748a21958fe1 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:10.263203 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cae50-c693-440d-ab78-3853c7849745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:10.263901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cae50-c693-440d-ab78-3853c7849745 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:10.264185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cae50-c693-440d-ab78-3853c7849745 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:10.264465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028cae50-c693-440d-ab78-3853c7849745 None admin] PATH_INFO: `/v3/users/1e7ab09e16d5429fb7b5f83298543220` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:10.267172 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cae50-c693-440d-ab78-3853c7849745 None admin] RBAC: Authorizing `identity:get_user(user_id=1e7ab09e16d5429fb7b5f83298543220)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:10.268696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028cae50-c693-440d-ab78-3853c7849745 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:10.270328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 148/286] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:10 2022] GET /identity/v3/users/1e7ab09e16d5429fb7b5f83298543220 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:10.275887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6666-c1aa-49f0-81ba-9a8e3b0db86b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:10.367894 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:10.411067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbb6666-c1aa-49f0-81ba-9a8e3b0db86b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:10.428181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cae50-c693-440d-ab78-3853c7849745 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:10.482952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cc008-f3fc-485d-b25e-67ab3fb05264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:10.483592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cc008-f3fc-485d-b25e-67ab3fb05264 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:10.483872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cc008-f3fc-485d-b25e-67ab3fb05264 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:10.484144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cc008-f3fc-485d-b25e-67ab3fb05264 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:10.489668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cc008-f3fc-485d-b25e-67ab3fb05264 None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:10.491116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cc008-f3fc-485d-b25e-67ab3fb05264 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:10.492884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 139/287] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:10 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:10.501770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cc008-f3fc-485d-b25e-67ab3fb05264 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:10.558640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:10.608732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028cae50-c693-440d-ab78-3853c7849745 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:10.657066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cc008-f3fc-485d-b25e-67ab3fb05264 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:10.682107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593ca41-e100-4a22-83e2-c7f0592cdf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:10.682748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ca41-e100-4a22-83e2-c7f0592cdf9a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:10.683028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ca41-e100-4a22-83e2-c7f0592cdf9a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:10.683301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593ca41-e100-4a22-83e2-c7f0592cdf9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:10.697509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93d04-846e-45ae-8f4e-f32019550f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:10.698181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93d04-846e-45ae-8f4e-f32019550f6b None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:10.698466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93d04-846e-45ae-8f4e-f32019550f6b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:10.698743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b93d04-846e-45ae-8f4e-f32019550f6b None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac/users/1e7ab09e16d5429fb7b5f83298543220/roles/f7cd8cb4f15b496e933c06d4f359a934` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:10.701735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b93d04-846e-45ae-8f4e-f32019550f6b None admin] RBAC: Authorizing `identity:create_grant(project_id=aa0906069f964316869e9e61168bf8ac, user_id=1e7ab09e16d5429fb7b5f83298543220, role_id=f7cd8cb4f15b496e933c06d4f359a934)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:10.705607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b93d04-846e-45ae-8f4e-f32019550f6b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:10.708148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593ca41-e100-4a22-83e2-c7f0592cdf9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:10.714350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-9593ca41-e100-4a22-83e2-c7f0592cdf9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:10.715366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:10.716232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:10.717102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:10.718726 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 149/288] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:10.726165 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593ca41-e100-4a22-83e2-c7f0592cdf9a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:10.740896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 140/289] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:10 2022] PUT /identity/v3/projects/aa0906069f964316869e9e61168bf8ac/users/1e7ab09e16d5429fb7b5f83298543220/roles/f7cd8cb4f15b496e933c06d4f359a934 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:10.848615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593ca41-e100-4a22-83e2-c7f0592cdf9a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:10.890264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65188e7e-7736-43d7-ac01-44bcc0c3c224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:10.891452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65188e7e-7736-43d7-ac01-44bcc0c3c224 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:10.891735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65188e7e-7736-43d7-ac01-44bcc0c3c224 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:10.892010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65188e7e-7736-43d7-ac01-44bcc0c3c224 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:10.892696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65188e7e-7736-43d7-ac01-44bcc0c3c224 None admin] RBAC: Adding query filter params (name=member) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:10.893090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65188e7e-7736-43d7-ac01-44bcc0c3c224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:10.894539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65188e7e-7736-43d7-ac01-44bcc0c3c224 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:10.896176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:10.907373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 150/290] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:10.913232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93d04-846e-45ae-8f4e-f32019550f6b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:11.049676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b93d04-846e-45ae-8f4e-f32019550f6b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:11.086025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5082e-5435-448e-83a5-e7724ba411cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:11.086671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5082e-5435-448e-83a5-e7724ba411cc None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.087076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5082e-5435-448e-83a5-e7724ba411cc None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.087349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f5082e-5435-448e-83a5-e7724ba411cc None admin] PATH_INFO: `/v3/users/2ad5f5e4db774a57bb3ce0e2f890e886` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.088751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5082e-5435-448e-83a5-e7724ba411cc None admin] RBAC: Authorizing `identity:get_user(user_id=2ad5f5e4db774a57bb3ce0e2f890e886)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:11.090229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f5082e-5435-448e-83a5-e7724ba411cc None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:11.091884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 141/291] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:10 2022] GET /identity/v3/users/2ad5f5e4db774a57bb3ce0e2f890e886 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:11.097607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65188e7e-7736-43d7-ac01-44bcc0c3c224 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:11.218358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65188e7e-7736-43d7-ac01-44bcc0c3c224 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:11.264570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe608b-fd34-4d5b-af00-5ef77d0295ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:11.265192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe608b-fd34-4d5b-af00-5ef77d0295ed None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.265501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe608b-fd34-4d5b-af00-5ef77d0295ed None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.265856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbe608b-fd34-4d5b-af00-5ef77d0295ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.347707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:11.357142 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe608b-fd34-4d5b-af00-5ef77d0295ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:11.358922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbe608b-fd34-4d5b-af00-5ef77d0295ed None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:11.474852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 151/292] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:11.480641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5082e-5435-448e-83a5-e7724ba411cc None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:11.546502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:11.588001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f5082e-5435-448e-83a5-e7724ba411cc None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:11.624504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b971b1-196a-4781-bd6b-41b48c370e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:11.625892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b971b1-196a-4781-bd6b-41b48c370e5b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.626609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b971b1-196a-4781-bd6b-41b48c370e5b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.627358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b971b1-196a-4781-bd6b-41b48c370e5b None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.628858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b971b1-196a-4781-bd6b-41b48c370e5b None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:11.630488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b971b1-196a-4781-bd6b-41b48c370e5b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:11.632297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 142/293] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:11 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:11.638348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe608b-fd34-4d5b-af00-5ef77d0295ed None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:11.781388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:11.787301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d28b3-9cfc-4d7a-9a17-8ff63ab7f054 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.787842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d28b3-9cfc-4d7a-9a17-8ff63ab7f054 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.788319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d28b3-9cfc-4d7a-9a17-8ff63ab7f054 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.788654 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbe608b-fd34-4d5b-af00-5ef77d0295ed None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:11.790098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 143/294] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:11.795202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8457-6400-4d60-ac1f-eaff7c1669f0 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.795766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8457-6400-4d60-ac1f-eaff7c1669f0 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.796240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f8457-6400-4d60-ac1f-eaff7c1669f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.815706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6b6f8457-6400-4d60-ac1f-eaff7c1669f0 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:11.817686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6b6f8457-6400-4d60-ac1f-eaff7c1669f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:11.843472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af1da8-6dd0-478d-948c-ba2fc5fcea75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:11.844176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af1da8-6dd0-478d-948c-ba2fc5fcea75 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.844461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af1da8-6dd0-478d-948c-ba2fc5fcea75 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.844736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af1da8-6dd0-478d-948c-ba2fc5fcea75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.845518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af1da8-6dd0-478d-948c-ba2fc5fcea75 None admin] RBAC: Adding query filter params (role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=aa0906069f964316869e9e61168bf8ac, user.id=2ad5f5e4db774a57bb3ce0e2f890e886) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:11.845836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af1da8-6dd0-478d-948c-ba2fc5fcea75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:11.847418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af1da8-6dd0-478d-948c-ba2fc5fcea75 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:11.854245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 152/295] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:11 2022] GET /identity/v3/role_assignments?user.id=2ad5f5e4db774a57bb3ce0e2f890e886&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=165f39c0a24042fdacc0121c96347bcd => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:11.855465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eb049-1453-46fd-9d55-b04b2b1ebd3b None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.855752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eb049-1453-46fd-9d55-b04b2b1ebd3b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.856033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494eb049-1453-46fd-9d55-b04b2b1ebd3b None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.870814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 153/296] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:11 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:11.879985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d395-6d0f-49ce-b400-95019043dcfc None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.880261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d395-6d0f-49ce-b400-95019043dcfc None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.880706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9522d395-6d0f-49ce-b400-95019043dcfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.909901 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 144/297] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:11.920760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9522d395-6d0f-49ce-b400-95019043dcfc None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:11.922257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9522d395-6d0f-49ce-b400-95019043dcfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:11.950939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f5e37-39a1-4970-8d5e-fdb7e1921b59 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.951453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f5e37-39a1-4970-8d5e-fdb7e1921b59 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.951572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f5e37-39a1-4970-8d5e-fdb7e1921b59 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.952943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 145/298] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:11.958664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db165e72-f5c0-43a3-9006-cd7b3b5ba17f None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:11.958934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db165e72-f5c0-43a3-9006-cd7b3b5ba17f None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:11.959206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db165e72-f5c0-43a3-9006-cd7b3b5ba17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:11.998990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-db165e72-f5c0-43a3-9006-cd7b3b5ba17f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:12.001336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-db165e72-f5c0-43a3-9006-cd7b3b5ba17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:12.057862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 154/299] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:12.077794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.094840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 146/300] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:12.231007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522d395-6d0f-49ce-b400-95019043dcfc None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.348629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.361636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9522d395-6d0f-49ce-b400-95019043dcfc None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.364821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db165e72-f5c0-43a3-9006-cd7b3b5ba17f None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.402897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faca68-22cc-41cd-8662-9bee516761cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.403600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faca68-22cc-41cd-8662-9bee516761cb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.403881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faca68-22cc-41cd-8662-9bee516761cb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.404208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faca68-22cc-41cd-8662-9bee516761cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.415296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53faca68-22cc-41cd-8662-9bee516761cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-53faca68-22cc-41cd-8662-9bee516761cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:12.420110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:12.421006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:12.421839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 155/301] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:12.423057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faca68-22cc-41cd-8662-9bee516761cb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.488068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db165e72-f5c0-43a3-9006-cd7b3b5ba17f None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.523582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038205d3-c2de-476d-859c-df2e60778cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.524328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038205d3-c2de-476d-859c-df2e60778cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.524602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038205d3-c2de-476d-859c-df2e60778cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.524890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038205d3-c2de-476d-859c-df2e60778cc0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.530814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faca68-22cc-41cd-8662-9bee516761cb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.536842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038205d3-c2de-476d-859c-df2e60778cc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-038205d3-c2de-476d-859c-df2e60778cc0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:12.541998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:12.543063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 147/302] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:12.543871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038205d3-c2de-476d-859c-df2e60778cc0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.574472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6b5d7-a969-457b-a095-78da46761e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.575562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6b5d7-a969-457b-a095-78da46761e82 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.576280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6b5d7-a969-457b-a095-78da46761e82 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.576982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f6b5d7-a969-457b-a095-78da46761e82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.578491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6b5d7-a969-457b-a095-78da46761e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.580616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f6b5d7-a969-457b-a095-78da46761e82 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.583387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 156/303] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:12.584294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6b5d7-a969-457b-a095-78da46761e82 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.602142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.606558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.654250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038205d3-c2de-476d-859c-df2e60778cc0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.690485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997c0f2-215b-4dda-a18b-f17cc04ac503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.691091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997c0f2-215b-4dda-a18b-f17cc04ac503 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.691371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997c0f2-215b-4dda-a18b-f17cc04ac503 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.691651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997c0f2-215b-4dda-a18b-f17cc04ac503 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.691846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f6b5d7-a969-457b-a095-78da46761e82 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.692319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997c0f2-215b-4dda-a18b-f17cc04ac503 None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:12.692628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997c0f2-215b-4dda-a18b-f17cc04ac503 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.694040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5997c0f2-215b-4dda-a18b-f17cc04ac503 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.702287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 148/304] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:12.703277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997c0f2-215b-4dda-a18b-f17cc04ac503 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.732541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc4045-5132-4425-a9ad-c24a9efcd060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.733378 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc4045-5132-4425-a9ad-c24a9efcd060 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.733835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc4045-5132-4425-a9ad-c24a9efcd060 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.734254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc4045-5132-4425-a9ad-c24a9efcd060 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.735629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc4045-5132-4425-a9ad-c24a9efcd060 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:12.736081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc4045-5132-4425-a9ad-c24a9efcd060 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.737657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc4045-5132-4425-a9ad-c24a9efcd060 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.746069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 157/305] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:12.747015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc4045-5132-4425-a9ad-c24a9efcd060 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.812883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5997c0f2-215b-4dda-a18b-f17cc04ac503 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.828945 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.829930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:12.850548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc4045-5132-4425-a9ad-c24a9efcd060 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:12.852254 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918c4c1-bc6a-43ab-b262-4c6c1abe02ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.852805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918c4c1-bc6a-43ab-b262-4c6c1abe02ab None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.853081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918c4c1-bc6a-43ab-b262-4c6c1abe02ab None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.853350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3918c4c1-bc6a-43ab-b262-4c6c1abe02ab None admin] PATH_INFO: `/v3/groups` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.854004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918c4c1-bc6a-43ab-b262-4c6c1abe02ab None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.855493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3918c4c1-bc6a-43ab-b262-4c6c1abe02ab None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.871425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 149/306] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Sep 17 00:35:12 2022] POST /identity/v3/groups => generated 229 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:12.882554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918c4c1-bc6a-43ab-b262-4c6c1abe02ab None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:12.897877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097cb8b-7471-4044-b8f4-98901cc43e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:12.898535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097cb8b-7471-4044-b8f4-98901cc43e56 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:12.898812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097cb8b-7471-4044-b8f4-98901cc43e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:12.899086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5097cb8b-7471-4044-b8f4-98901cc43e56 None admin] PATH_INFO: `/v3/users/0444b02a83bc4760b9c9b44f5114f133` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:12.902536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097cb8b-7471-4044-b8f4-98901cc43e56 None admin] RBAC: Authorizing `identity:get_user(user_id=0444b02a83bc4760b9c9b44f5114f133)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:12.904006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5097cb8b-7471-4044-b8f4-98901cc43e56 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:12.905729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 158/307] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/users/0444b02a83bc4760b9c9b44f5114f133 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:12.912294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097cb8b-7471-4044-b8f4-98901cc43e56 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:13.039308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3918c4c1-bc6a-43ab-b262-4c6c1abe02ab None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.055376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5097cb8b-7471-4044-b8f4-98901cc43e56 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.083280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b182780-f028-4ee3-a6f4-613fa2689601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.083925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b182780-f028-4ee3-a6f4-613fa2689601 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.084207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b182780-f028-4ee3-a6f4-613fa2689601 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.084484 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b182780-f028-4ee3-a6f4-613fa2689601 None admin] PATH_INFO: `/v3/users/0ac3a0c003594872b087c9c9350f8dcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.094894 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a9f458-903d-40eb-aa59-389899b010e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.096197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9f458-903d-40eb-aa59-389899b010e5 None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.096197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9f458-903d-40eb-aa59-389899b010e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.096373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a9f458-903d-40eb-aa59-389899b010e5 None admin] PATH_INFO: `/v3/system/users/0444b02a83bc4760b9c9b44f5114f133/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.098268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9f458-903d-40eb-aa59-389899b010e5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0444b02a83bc4760b9c9b44f5114f133, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.099656 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a9f458-903d-40eb-aa59-389899b010e5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.099961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b182780-f028-4ee3-a6f4-613fa2689601 None admin] RBAC: Authorizing `identity:get_user(user_id=0ac3a0c003594872b087c9c9350f8dcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.101425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b182780-f028-4ee3-a6f4-613fa2689601 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.105514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 150/308] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:12 2022] GET /identity/v3/users/0ac3a0c003594872b087c9c9350f8dcd => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:13.109226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b182780-f028-4ee3-a6f4-613fa2689601 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:13.115935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 159/309] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Sep 17 00:35:12 2022] PUT /identity/v3/system/users/0444b02a83bc4760b9c9b44f5114f133/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:13.148507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:13.232777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b182780-f028-4ee3-a6f4-613fa2689601 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.273778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09acf650-43f8-42c9-b13e-9330d5f888ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.274408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acf650-43f8-42c9-b13e-9330d5f888ed None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.274677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acf650-43f8-42c9-b13e-9330d5f888ed None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.274952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09acf650-43f8-42c9-b13e-9330d5f888ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.275706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acf650-43f8-42c9-b13e-9330d5f888ed None admin] RBAC: Adding query filter params (role.id=f7cd8cb4f15b496e933c06d4f359a934, user.id=0ac3a0c003594872b087c9c9350f8dcd, scope.system=all) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:13.276012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acf650-43f8-42c9-b13e-9330d5f888ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:13.277500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09acf650-43f8-42c9-b13e-9330d5f888ed None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:13.284627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 151/310] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 17 00:35:13 2022] GET /identity/v3/role_assignments?user.id=0ac3a0c003594872b087c9c9350f8dcd&scope.system=all&role.id=f7cd8cb4f15b496e933c06d4f359a934 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:13.461828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8869f2-46de-4296-b6ff-2401209afa37 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.462339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8869f2-46de-4296-b6ff-2401209afa37 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.462415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8869f2-46de-4296-b6ff-2401209afa37 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.464097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 160/311] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:13.470799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68f17-0e49-4d4f-94f8-8166af209c18 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.471394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68f17-0e49-4d4f-94f8-8166af209c18 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.471870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e68f17-0e49-4d4f-94f8-8166af209c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:13.491735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d7e68f17-0e49-4d4f-94f8-8166af209c18 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:13.492930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d7e68f17-0e49-4d4f-94f8-8166af209c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:13.563114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 152/312] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:13.841998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8869f2-46de-4296-b6ff-2401209afa37 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:13.858112 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:13.956232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8869f2-46de-4296-b6ff-2401209afa37 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:13.993288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8d6db-c134-4cd9-9c3f-b0b5b7023c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:13.993955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8d6db-c134-4cd9-9c3f-b0b5b7023c34 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:13.994231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8d6db-c134-4cd9-9c3f-b0b5b7023c34 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:13.994514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa8d6db-c134-4cd9-9c3f-b0b5b7023c34 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:14.005557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa8d6db-c134-4cd9-9c3f-b0b5b7023c34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-8fa8d6db-c134-4cd9-9c3f-b0b5b7023c34 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:14.011193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:14.012091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:14.013056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 161/313] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:14.020636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68f17-0e49-4d4f-94f8-8166af209c18 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:14.048297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:14.125090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e68f17-0e49-4d4f-94f8-8166af209c18 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:14.163688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc170ea-904c-4ec1-9367-d5a1c20b6658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:14.164309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc170ea-904c-4ec1-9367-d5a1c20b6658 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:14.164588 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc170ea-904c-4ec1-9367-d5a1c20b6658 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:14.164862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc170ea-904c-4ec1-9367-d5a1c20b6658 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:14.165565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc170ea-904c-4ec1-9367-d5a1c20b6658 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:14.165871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc170ea-904c-4ec1-9367-d5a1c20b6658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:14.167257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc170ea-904c-4ec1-9367-d5a1c20b6658 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:14.175606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 153/314] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:14.181417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8d6db-c134-4cd9-9c3f-b0b5b7023c34 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:14.261272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:14.292354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa8d6db-c134-4cd9-9c3f-b0b5b7023c34 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:14.327098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68526ed1-2720-443d-ac77-0da8eb079795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:14.327764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68526ed1-2720-443d-ac77-0da8eb079795 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:14.328013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68526ed1-2720-443d-ac77-0da8eb079795 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:14.328314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68526ed1-2720-443d-ac77-0da8eb079795 None admin] PATH_INFO: `/v3/users/1e7ab09e16d5429fb7b5f83298543220` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:14.329462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68526ed1-2720-443d-ac77-0da8eb079795 None admin] RBAC: Authorizing `identity:get_user(user_id=1e7ab09e16d5429fb7b5f83298543220)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:14.330923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68526ed1-2720-443d-ac77-0da8eb079795 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:14.332805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 162/315] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:14 2022] GET /identity/v3/users/1e7ab09e16d5429fb7b5f83298543220 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:14.338564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc170ea-904c-4ec1-9367-d5a1c20b6658 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:14.430980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:14.443957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc170ea-904c-4ec1-9367-d5a1c20b6658 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:14.479132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7461972-4cac-4490-9a58-2caf52b5af7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:14.479750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7461972-4cac-4490-9a58-2caf52b5af7d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:14.480027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7461972-4cac-4490-9a58-2caf52b5af7d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:14.480300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7461972-4cac-4490-9a58-2caf52b5af7d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:14.547461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7461972-4cac-4490-9a58-2caf52b5af7d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:14.548920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7461972-4cac-4490-9a58-2caf52b5af7d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:14.647575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 154/316] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:14.648912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:14.652956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68526ed1-2720-443d-ac77-0da8eb079795 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:14.755562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68526ed1-2720-443d-ac77-0da8eb079795 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:14.790360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07266fe3-c749-478f-8347-1bcf1b9518cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:14.790993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07266fe3-c749-478f-8347-1bcf1b9518cf None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:14.791273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07266fe3-c749-478f-8347-1bcf1b9518cf None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:14.791550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07266fe3-c749-478f-8347-1bcf1b9518cf None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:14.792665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07266fe3-c749-478f-8347-1bcf1b9518cf None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:14.794141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07266fe3-c749-478f-8347-1bcf1b9518cf None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:14.795762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 163/317] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:14 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:14.802145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7461972-4cac-4490-9a58-2caf52b5af7d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:14.904366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7461972-4cac-4490-9a58-2caf52b5af7d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:14.940757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6d07a3-0303-4f9d-a991-c41919555fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:14.941369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d07a3-0303-4f9d-a991-c41919555fed None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:14.941672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d07a3-0303-4f9d-a991-c41919555fed None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:14.941944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6d07a3-0303-4f9d-a991-c41919555fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:14.942683 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d07a3-0303-4f9d-a991-c41919555fed None admin] RBAC: Adding query filter params (role.id=f7cd8cb4f15b496e933c06d4f359a934, scope.project.id=aa0906069f964316869e9e61168bf8ac, user.id=1e7ab09e16d5429fb7b5f83298543220) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:14.942987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d07a3-0303-4f9d-a991-c41919555fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:14.944426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6d07a3-0303-4f9d-a991-c41919555fed None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:14.950445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 155/318] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:14 2022] GET /identity/v3/role_assignments?user.id=1e7ab09e16d5429fb7b5f83298543220&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=f7cd8cb4f15b496e933c06d4f359a934 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:15.253861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d78dc-ab4a-4beb-9356-5ee4455552e1 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.254226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d78dc-ab4a-4beb-9356-5ee4455552e1 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.254420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208d78dc-ab4a-4beb-9356-5ee4455552e1 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.255791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 164/319] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:15.261794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be871-1988-44ac-ad8c-baa8def26f64 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.262424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be871-1988-44ac-ad8c-baa8def26f64 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.262424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6be871-1988-44ac-ad8c-baa8def26f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.282159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-db6be871-1988-44ac-ad8c-baa8def26f64 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:15.283338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-db6be871-1988-44ac-ad8c-baa8def26f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:15.332294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:15.353204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 156/320] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:15.369089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e1746-ee13-433c-a2e6-633293102301 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.369373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e1746-ee13-433c-a2e6-633293102301 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.369684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e1746-ee13-433c-a2e6-633293102301 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.371136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 165/321] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:15.376290 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6d698-9038-42b5-a342-7a82370cb3e8 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.376578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6d698-9038-42b5-a342-7a82370cb3e8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.376846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d6d698-9038-42b5-a342-7a82370cb3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.395287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f2d6d698-9038-42b5-a342-7a82370cb3e8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:15.396449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f2d6d698-9038-42b5-a342-7a82370cb3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:15.475127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 157/322] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:15.561185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d8f3-d665-484a-94a3-a7bdf5a66fc0 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.561507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d8f3-d665-484a-94a3-a7bdf5a66fc0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.561694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a123d8f3-d665-484a-94a3-a7bdf5a66fc0 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.563245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 166/323] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:15.568126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ebef-c456-4a9a-bbd8-36556155c207 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.568417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ebef-c456-4a9a-bbd8-36556155c207 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.568694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5ebef-c456-4a9a-bbd8-36556155c207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.587190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7bd5ebef-c456-4a9a-bbd8-36556155c207 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:15.588628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7bd5ebef-c456-4a9a-bbd8-36556155c207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:15.621523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123d8f3-d665-484a-94a3-a7bdf5a66fc0 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:15.640658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:15.657609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 158/324] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:15.735205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a123d8f3-d665-484a-94a3-a7bdf5a66fc0 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:15.740718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5ebef-c456-4a9a-bbd8-36556155c207 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:15.769132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7742-2b58-4be6-937a-ac0e7c225cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:15.769793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7742-2b58-4be6-937a-ac0e7c225cfd None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.770072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7742-2b58-4be6-937a-ac0e7c225cfd None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.770346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447b7742-2b58-4be6-937a-ac0e7c225cfd None admin] PATH_INFO: `/v3/domains/default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.771452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b7742-2b58-4be6-937a-ac0e7c225cfd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:15.773009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447b7742-2b58-4be6-937a-ac0e7c225cfd None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:15.777447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 167/325] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:15.779917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7742-2b58-4be6-937a-ac0e7c225cfd None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:15.792213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:15.851439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5ebef-c456-4a9a-bbd8-36556155c207 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:15.863951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:15.886723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447b7742-2b58-4be6-937a-ac0e7c225cfd None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:15.887314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e2ab2-cb8e-458a-9867-aa9014a44886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:15.888220 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e2ab2-cb8e-458a-9867-aa9014a44886 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.888643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e2ab2-cb8e-458a-9867-aa9014a44886 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.889068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e2ab2-cb8e-458a-9867-aa9014a44886 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.899403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e2ab2-cb8e-458a-9867-aa9014a44886 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-475e2ab2-cb8e-458a-9867-aa9014a44886 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:15.905872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:15.907273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:15.908083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:15.910436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 159/326] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:15.915956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e2ab2-cb8e-458a-9867-aa9014a44886 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:15.924890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8582e2-ef98-4400-81d9-e926cdd1e417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:15.925558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8582e2-ef98-4400-81d9-e926cdd1e417 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:15.925837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8582e2-ef98-4400-81d9-e926cdd1e417 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:15.926114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8582e2-ef98-4400-81d9-e926cdd1e417 None admin] PATH_INFO: `/v3/groups` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:15.926745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8582e2-ef98-4400-81d9-e926cdd1e417 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:15.928179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8582e2-ef98-4400-81d9-e926cdd1e417 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:15.952029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 168/327] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Sep 17 00:35:15 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:15.952029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8582e2-ef98-4400-81d9-e926cdd1e417 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.043566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e2ab2-cb8e-458a-9867-aa9014a44886 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.046132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.061875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8582e2-ef98-4400-81d9-e926cdd1e417 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.085888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3132f7-e3c6-4c35-bad9-e3d36ae36f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.086503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3132f7-e3c6-4c35-bad9-e3d36ae36f07 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.086778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3132f7-e3c6-4c35-bad9-e3d36ae36f07 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.087054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3132f7-e3c6-4c35-bad9-e3d36ae36f07 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.087734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3132f7-e3c6-4c35-bad9-e3d36ae36f07 None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:16.088040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3132f7-e3c6-4c35-bad9-e3d36ae36f07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.089900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3132f7-e3c6-4c35-bad9-e3d36ae36f07 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.099567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 160/328] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:16.101644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25086ace-0355-4e87-8f08-d0dc748c157a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.102225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25086ace-0355-4e87-8f08-d0dc748c157a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.102506 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25086ace-0355-4e87-8f08-d0dc748c157a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.102780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25086ace-0355-4e87-8f08-d0dc748c157a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.104908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3132f7-e3c6-4c35-bad9-e3d36ae36f07 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.107379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.120785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25086ace-0355-4e87-8f08-d0dc748c157a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-25086ace-0355-4e87-8f08-d0dc748c157a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:16.126450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:16.127407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:16.128336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:16.130244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 169/329] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:16.137395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25086ace-0355-4e87-8f08-d0dc748c157a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.230846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3132f7-e3c6-4c35-bad9-e3d36ae36f07 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.260724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25086ace-0355-4e87-8f08-d0dc748c157a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.272892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ed6ec-fd37-4fb9-8564-03578e4498bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.274094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ed6ec-fd37-4fb9-8564-03578e4498bc None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.274517 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ed6ec-fd37-4fb9-8564-03578e4498bc None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.274967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ed6ec-fd37-4fb9-8564-03578e4498bc None admin] PATH_INFO: `/v3/users/0444b02a83bc4760b9c9b44f5114f133` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.276182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ed6ec-fd37-4fb9-8564-03578e4498bc None admin] RBAC: Authorizing `identity:get_user(user_id=0444b02a83bc4760b9c9b44f5114f133)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.277656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ed6ec-fd37-4fb9-8564-03578e4498bc None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.279822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 161/330] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/users/0444b02a83bc4760b9c9b44f5114f133 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:16.285646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ed6ec-fd37-4fb9-8564-03578e4498bc None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.304126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9a378-19e0-443c-bc22-73e1f8f1f303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.304762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9a378-19e0-443c-bc22-73e1f8f1f303 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.305040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9a378-19e0-443c-bc22-73e1f8f1f303 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.305317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9a378-19e0-443c-bc22-73e1f8f1f303 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.306823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9a378-19e0-443c-bc22-73e1f8f1f303 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:16.307126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9a378-19e0-443c-bc22-73e1f8f1f303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.308522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9a378-19e0-443c-bc22-73e1f8f1f303 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.319390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 170/331] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:16.323322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.325492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9a378-19e0-443c-bc22-73e1f8f1f303 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.399399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.429557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ed6ec-fd37-4fb9-8564-03578e4498bc None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.453138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9a378-19e0-443c-bc22-73e1f8f1f303 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.475067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7c951-76e4-45c6-9e88-e8580545180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.475682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7c951-76e4-45c6-9e88-e8580545180e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.475960 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7c951-76e4-45c6-9e88-e8580545180e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.476242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7c951-76e4-45c6-9e88-e8580545180e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.477294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7c951-76e4-45c6-9e88-e8580545180e None admin] RBAC: Adding query filter params (role.id=165f39c0a24042fdacc0121c96347bcd, user.id=0444b02a83bc4760b9c9b44f5114f133, scope.system=all) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:16.477629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7c951-76e4-45c6-9e88-e8580545180e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.479074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7c951-76e4-45c6-9e88-e8580545180e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.494366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 162/332] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/role_assignments?user.id=0444b02a83bc4760b9c9b44f5114f133&scope.system=all&role.id=165f39c0a24042fdacc0121c96347bcd => generated 510 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:16.496153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60151e6-8cef-4180-93db-7280ab59e2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.496800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60151e6-8cef-4180-93db-7280ab59e2ff None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.497078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60151e6-8cef-4180-93db-7280ab59e2ff None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.497351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60151e6-8cef-4180-93db-7280ab59e2ff None admin] PATH_INFO: `/v3/users/0ac3a0c003594872b087c9c9350f8dcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.498581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60151e6-8cef-4180-93db-7280ab59e2ff None admin] RBAC: Authorizing `identity:get_user(user_id=0ac3a0c003594872b087c9c9350f8dcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.500699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60151e6-8cef-4180-93db-7280ab59e2ff None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.502428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 171/333] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:16 2022] GET /identity/v3/users/0ac3a0c003594872b087c9c9350f8dcd => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:16.508533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7c951-76e4-45c6-9e88-e8580545180e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:16.614058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:16.626421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7c951-76e4-45c6-9e88-e8580545180e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:16.664388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07532846-c37b-449d-8e60-229049426133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:16.664985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532846-c37b-449d-8e60-229049426133 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:16.665262 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532846-c37b-449d-8e60-229049426133 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:16.665561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07532846-c37b-449d-8e60-229049426133 None admin] PATH_INFO: `/v3/system/users/0ac3a0c003594872b087c9c9350f8dcd/roles/f7cd8cb4f15b496e933c06d4f359a934` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:16.667051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07532846-c37b-449d-8e60-229049426133 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0ac3a0c003594872b087c9c9350f8dcd, role_id=f7cd8cb4f15b496e933c06d4f359a934)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:16.668768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07532846-c37b-449d-8e60-229049426133 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:16.678933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 163/334] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Sep 17 00:35:16 2022] PUT /identity/v3/system/users/0ac3a0c003594872b087c9c9350f8dcd/roles/f7cd8cb4f15b496e933c06d4f359a934 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:18.374178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a282-b974-47c1-8f72-d82e412cf47e None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.374688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a282-b974-47c1-8f72-d82e412cf47e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.374688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78a282-b974-47c1-8f72-d82e412cf47e None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:18.376409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 172/335] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:18.382532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31f451-88d6-4b70-9dda-1f3a9278d89a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.382953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31f451-88d6-4b70-9dda-1f3a9278d89a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.383128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b31f451-88d6-4b70-9dda-1f3a9278d89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:18.402455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2b31f451-88d6-4b70-9dda-1f3a9278d89a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:18.403631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2b31f451-88d6-4b70-9dda-1f3a9278d89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:18.488192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 164/336] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:18.769087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78a282-b974-47c1-8f72-d82e412cf47e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:18.838696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1da9c-fb1e-423b-bc63-5d7f1140c8e5 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.839280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1da9c-fb1e-423b-bc63-5d7f1140c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.839753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa1da9c-fb1e-423b-bc63-5d7f1140c8e5 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:18.842692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 165/337] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:18.851078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88fc2a-d211-477e-9fd7-d4d06416c0c2 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.851639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88fc2a-d211-477e-9fd7-d4d06416c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.852126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a88fc2a-d211-477e-9fd7-d4d06416c0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:18.876701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2a88fc2a-d211-477e-9fd7-d4d06416c0c2 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:18.878365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2a88fc2a-d211-477e-9fd7-d4d06416c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:18.920578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78a282-b974-47c1-8f72-d82e412cf47e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:18.969803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:18.980940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb12ae-f011-4611-bc17-dc1b996d988c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:18.981681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb12ae-f011-4611-bc17-dc1b996d988c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:18.981964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb12ae-f011-4611-bc17-dc1b996d988c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:18.982239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb12ae-f011-4611-bc17-dc1b996d988c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.001083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb12ae-f011-4611-bc17-dc1b996d988c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:19.005126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 166/338] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-d7fb12ae-f011-4611-bc17-dc1b996d988c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:19.010849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:19.013640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:19.014442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 173/339] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:19.018939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88fc2a-d211-477e-9fd7-d4d06416c0c2 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.038403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:19.157575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a88fc2a-d211-477e-9fd7-d4d06416c0c2 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:19.193225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26c0e2-0b2b-448d-af3e-45e9bdd1bea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:19.194139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26c0e2-0b2b-448d-af3e-45e9bdd1bea5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.194415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26c0e2-0b2b-448d-af3e-45e9bdd1bea5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.194685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db26c0e2-0b2b-448d-af3e-45e9bdd1bea5 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.195358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26c0e2-0b2b-448d-af3e-45e9bdd1bea5 None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:19.195656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26c0e2-0b2b-448d-af3e-45e9bdd1bea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:19.197050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db26c0e2-0b2b-448d-af3e-45e9bdd1bea5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:19.205844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 167/340] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:19.211488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb12ae-f011-4611-bc17-dc1b996d988c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.314707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26c0e2-0b2b-448d-af3e-45e9bdd1bea5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.321765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb12ae-f011-4611-bc17-dc1b996d988c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:19.365681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da6ebf-32df-4bf0-acdd-6bb5f0e9b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:19.366439 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da6ebf-32df-4bf0-acdd-6bb5f0e9b671 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.366728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da6ebf-32df-4bf0-acdd-6bb5f0e9b671 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.367002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da6ebf-32df-4bf0-acdd-6bb5f0e9b671 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.449728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:19.479288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:19.479800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da6ebf-32df-4bf0-acdd-6bb5f0e9b671 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:19.482776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da6ebf-32df-4bf0-acdd-6bb5f0e9b671 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:19.522053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db26c0e2-0b2b-448d-af3e-45e9bdd1bea5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:19.581806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61a4a2-22c3-45b4-adda-99451953b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:19.582360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61a4a2-22c3-45b4-adda-99451953b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.582636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61a4a2-22c3-45b4-adda-99451953b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.582902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61a4a2-22c3-45b4-adda-99451953b1e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.602039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61a4a2-22c3-45b4-adda-99451953b1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-8c61a4a2-22c3-45b4-adda-99451953b1e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:19.607411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:19.608280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:19.609073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 168/341] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:19.620724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aabfec-3a8c-44d5-89d6-b7abedbd7ea1 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.621061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aabfec-3a8c-44d5-89d6-b7abedbd7ea1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.621480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aabfec-3a8c-44d5-89d6-b7abedbd7ea1 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.628062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 169/342] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:19 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:19.629234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aabfec-3a8c-44d5-89d6-b7abedbd7ea1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.671664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 174/343] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:19.672959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297984-a055-41a9-8243-d4cfba213c40 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.673248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297984-a055-41a9-8243-d4cfba213c40 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.673554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f297984-a055-41a9-8243-d4cfba213c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.710468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3f297984-a055-41a9-8243-d4cfba213c40 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:19.711692 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3f297984-a055-41a9-8243-d4cfba213c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:19.755949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aabfec-3a8c-44d5-89d6-b7abedbd7ea1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:19.807100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77ce6-a852-4846-ab70-ab5688ae687e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:19.808149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77ce6-a852-4846-ab70-ab5688ae687e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:19.809631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77ce6-a852-4846-ab70-ab5688ae687e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:19.810120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd77ce6-a852-4846-ab70-ab5688ae687e None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:19.811235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77ce6-a852-4846-ab70-ab5688ae687e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:19.813167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77ce6-a852-4846-ab70-ab5688ae687e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:19.814973 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd77ce6-a852-4846-ab70-ab5688ae687e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:19.820392 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:19.832236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 170/344] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:19.838778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77ce6-a852-4846-ab70-ab5688ae687e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.856241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 175/345] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:19.857074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297984-a055-41a9-8243-d4cfba213c40 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:19.888638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.022248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd77ce6-a852-4846-ab70-ab5688ae687e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.046166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f297984-a055-41a9-8243-d4cfba213c40 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.085822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04d4afa-0797-422f-aae2-c8fbdfca3481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.086392 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d4afa-0797-422f-aae2-c8fbdfca3481 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.086671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d4afa-0797-422f-aae2-c8fbdfca3481 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.086975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04d4afa-0797-422f-aae2-c8fbdfca3481 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.090941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d4afa-0797-422f-aae2-c8fbdfca3481 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.093138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04d4afa-0797-422f-aae2-c8fbdfca3481 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.094936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 171/346] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:20.097701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4e2af-00e5-42e2-8a09-8e7769ab09f9 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.097987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4e2af-00e5-42e2-8a09-8e7769ab09f9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.098266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4e2af-00e5-42e2-8a09-8e7769ab09f9 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.102781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 172/347] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:20.104905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4e2af-00e5-42e2-8a09-8e7769ab09f9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.111936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4526-e5bc-4256-a8a5-98b8757afff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.112559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4526-e5bc-4256-a8a5-98b8757afff5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.112844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4526-e5bc-4256-a8a5-98b8757afff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.113118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850e4526-e5bc-4256-a8a5-98b8757afff5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.233116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.236277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4526-e5bc-4256-a8a5-98b8757afff5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.238260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850e4526-e5bc-4256-a8a5-98b8757afff5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.261315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.279772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4e2af-00e5-42e2-8a09-8e7769ab09f9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.324447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777723f-1f00-4545-9dd1-7fc8f56d4384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.325097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777723f-1f00-4545-9dd1-7fc8f56d4384 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.325375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777723f-1f00-4545-9dd1-7fc8f56d4384 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.325694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777723f-1f00-4545-9dd1-7fc8f56d4384 None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.335021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777723f-1f00-4545-9dd1-7fc8f56d4384 None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.336683 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777723f-1f00-4545-9dd1-7fc8f56d4384 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.339105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 173/348] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:20.340292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862c5d-d96d-48ac-9568-3c1b33d928e2 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.340581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862c5d-d96d-48ac-9568-3c1b33d928e2 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.340859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862c5d-d96d-48ac-9568-3c1b33d928e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.364410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-01862c5d-d96d-48ac-9568-3c1b33d928e2 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:20.365648 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-01862c5d-d96d-48ac-9568-3c1b33d928e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:20.366790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 176/349] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:20.367830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4526-e5bc-4256-a8a5-98b8757afff5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.465337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 174/350] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:20.466303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01862c5d-d96d-48ac-9568-3c1b33d928e2 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.514669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850e4526-e5bc-4256-a8a5-98b8757afff5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.536261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.547845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.562950 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe7793-9d40-4e29-adc4-5a9500e806a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.563924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe7793-9d40-4e29-adc4-5a9500e806a3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.564394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe7793-9d40-4e29-adc4-5a9500e806a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.564873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe7793-9d40-4e29-adc4-5a9500e806a3 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.579757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe7793-9d40-4e29-adc4-5a9500e806a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-6dfe7793-9d40-4e29-adc4-5a9500e806a3 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:20.586159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:20.587153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 17 00:35:20.587965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:20.590796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 177/351] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:20.591991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe7793-9d40-4e29-adc4-5a9500e806a3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.598684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01862c5d-d96d-48ac-9568-3c1b33d928e2 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.641455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c638-faa3-4189-b56f-4f2b885db6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.642405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c638-faa3-4189-b56f-4f2b885db6f1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.642873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c638-faa3-4189-b56f-4f2b885db6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.643801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af4c638-faa3-4189-b56f-4f2b885db6f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.644770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4c638-faa3-4189-b56f-4f2b885db6f1 None admin] RBAC: Adding query filter params (group.id=c709958a577e4a2c866ea68c1e5b32be, role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:20.645280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4c638-faa3-4189-b56f-4f2b885db6f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.647792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af4c638-faa3-4189-b56f-4f2b885db6f1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.655827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 175/352] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/role_assignments?group.id=c709958a577e4a2c866ea68c1e5b32be&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=165f39c0a24042fdacc0121c96347bcd => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:20.657521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c638-faa3-4189-b56f-4f2b885db6f1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.717333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe7793-9d40-4e29-adc4-5a9500e806a3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.772087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886882e5-218b-4152-ab17-13837069659c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.772757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886882e5-218b-4152-ab17-13837069659c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.773037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886882e5-218b-4152-ab17-13837069659c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.773314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886882e5-218b-4152-ab17-13837069659c None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.775985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886882e5-218b-4152-ab17-13837069659c None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.777547 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886882e5-218b-4152-ab17-13837069659c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.781171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 178/353] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:20.790958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886882e5-218b-4152-ab17-13837069659c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:20.825781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af4c638-faa3-4189-b56f-4f2b885db6f1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:20.888526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.913567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f9758b-39b1-47b5-8ff4-416a833cb9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:20.914326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9758b-39b1-47b5-8ff4-416a833cb9b2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.914607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9758b-39b1-47b5-8ff4-416a833cb9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.914887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f9758b-39b1-47b5-8ff4-416a833cb9b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.915579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9758b-39b1-47b5-8ff4-416a833cb9b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:20.916074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:20.917213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9758b-39b1-47b5-8ff4-416a833cb9b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:20.918868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f9758b-39b1-47b5-8ff4-416a833cb9b2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:20.940869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 176/354] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:20.940869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd5cd-a7b0-4b21-8fa3-f581d9472c39 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.940869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd5cd-a7b0-4b21-8fa3-f581d9472c39 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.941205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bcd5cd-a7b0-4b21-8fa3-f581d9472c39 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.942539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 177/355] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:20.947939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613416b4-372e-48a3-bd6c-5a288e8a3fa1 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:20.948229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613416b4-372e-48a3-bd6c-5a288e8a3fa1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:20.948508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613416b4-372e-48a3-bd6c-5a288e8a3fa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:20.974296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-613416b4-372e-48a3-bd6c-5a288e8a3fa1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:20.975500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-613416b4-372e-48a3-bd6c-5a288e8a3fa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:21.002695 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886882e5-218b-4152-ab17-13837069659c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.052257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b951be3-b247-4d7a-a065-db539824c3c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.053329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b951be3-b247-4d7a-a065-db539824c3c4 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.053659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b951be3-b247-4d7a-a065-db539824c3c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.054200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b951be3-b247-4d7a-a065-db539824c3c4 None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.055578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b951be3-b247-4d7a-a065-db539824c3c4 None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.057771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b951be3-b247-4d7a-a065-db539824c3c4 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.060689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 179/356] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:20 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.063935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b951be3-b247-4d7a-a065-db539824c3c4 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.068582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 178/357] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:21.069719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613416b4-372e-48a3-bd6c-5a288e8a3fa1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.264432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613416b4-372e-48a3-bd6c-5a288e8a3fa1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.279866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b951be3-b247-4d7a-a065-db539824c3c4 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.301758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.307663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.331580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8a61-5c56-4e73-bba1-129e78af5052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.332203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8a61-5c56-4e73-bba1-129e78af5052 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.332483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8a61-5c56-4e73-bba1-129e78af5052 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.332759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627a8a61-5c56-4e73-bba1-129e78af5052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.333527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a8a61-5c56-4e73-bba1-129e78af5052 None admin] RBAC: Adding query filter params (group.id=c709958a577e4a2c866ea68c1e5b32be, role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:21.333838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a8a61-5c56-4e73-bba1-129e78af5052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.335283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627a8a61-5c56-4e73-bba1-129e78af5052 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.349391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 179/358] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/role_assignments?group.id=c709958a577e4a2c866ea68c1e5b32be&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 260 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.350284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8a61-5c56-4e73-bba1-129e78af5052 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.351373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58bca3-6d8a-4297-8be1-e38e27bbdac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.352104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58bca3-6d8a-4297-8be1-e38e27bbdac4 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.352384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58bca3-6d8a-4297-8be1-e38e27bbdac4 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.352662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58bca3-6d8a-4297-8be1-e38e27bbdac4 None admin] PATH_INFO: `/v3/users/0ac3a0c003594872b087c9c9350f8dcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.354238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58bca3-6d8a-4297-8be1-e38e27bbdac4 None admin] RBAC: Authorizing `identity:get_user(user_id=0ac3a0c003594872b087c9c9350f8dcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.355741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58bca3-6d8a-4297-8be1-e38e27bbdac4 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.357478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 180/359] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/users/0ac3a0c003594872b087c9c9350f8dcd => generated 293 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.365159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58bca3-6d8a-4297-8be1-e38e27bbdac4 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.518756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627a8a61-5c56-4e73-bba1-129e78af5052 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.532208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58bca3-6d8a-4297-8be1-e38e27bbdac4 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.564953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16750c-7a6f-410e-bc06-f88f607842c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.565859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16750c-7a6f-410e-bc06-f88f607842c1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.570323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16750c-7a6f-410e-bc06-f88f607842c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.570323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16750c-7a6f-410e-bc06-f88f607842c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.579331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40490754-1fb5-453c-8fe9-820c5b793177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.580373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40490754-1fb5-453c-8fe9-820c5b793177 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.580863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40490754-1fb5-453c-8fe9-820c5b793177 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.581347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40490754-1fb5-453c-8fe9-820c5b793177 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.582308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40490754-1fb5-453c-8fe9-820c5b793177 None admin] RBAC: Adding query filter params (role.id=f7cd8cb4f15b496e933c06d4f359a934, user.id=0ac3a0c003594872b087c9c9350f8dcd, scope.system=all) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:21.582837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40490754-1fb5-453c-8fe9-820c5b793177 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.582952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16750c-7a6f-410e-bc06-f88f607842c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:21.584765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40490754-1fb5-453c-8fe9-820c5b793177 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-ec16750c-7a6f-410e-bc06-f88f607842c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:21.589621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:21.590665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:21.591856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 180/360] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:21.592804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dea00-338f-4c98-b4e6-299ab75a10e8 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.592804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dea00-338f-4c98-b4e6-299ab75a10e8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.592804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184dea00-338f-4c98-b4e6-299ab75a10e8 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.594233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 181/361] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:21.595120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dea00-338f-4c98-b4e6-299ab75a10e8 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.603769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 181/362] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/role_assignments?user.id=0ac3a0c003594872b087c9c9350f8dcd&scope.system=all&role.id=f7cd8cb4f15b496e933c06d4f359a934 => generated 510 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.605125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40490754-1fb5-453c-8fe9-820c5b793177 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.655361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.684991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:21.754170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184dea00-338f-4c98-b4e6-299ab75a10e8 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.833880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40490754-1fb5-453c-8fe9-820c5b793177 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:21.836044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6853b-ae4d-45a6-bf8a-800d1e083675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.836698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6853b-ae4d-45a6-bf8a-800d1e083675 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.836975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6853b-ae4d-45a6-bf8a-800d1e083675 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.837242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6853b-ae4d-45a6-bf8a-800d1e083675 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.854892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6853b-ae4d-45a6-bf8a-800d1e083675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-a9d6853b-ae4d-45a6-bf8a-800d1e083675 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:21.862271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:21.863158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:21.863944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 182/363] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:21.865072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2942-5dd6-4961-86f4-7241571e5501 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.865072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2942-5dd6-4961-86f4-7241571e5501 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.865394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d2942-5dd6-4961-86f4-7241571e5501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.889870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-984d2942-5dd6-4961-86f4-7241571e5501 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:21.890053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44119cc1-e3fb-4eae-acec-fa431b2654f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:21.890726 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44119cc1-e3fb-4eae-acec-fa431b2654f2 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:21.891009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44119cc1-e3fb-4eae-acec-fa431b2654f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:21.891119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-984d2942-5dd6-4961-86f4-7241571e5501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:21.891293 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44119cc1-e3fb-4eae-acec-fa431b2654f2 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:21.891945 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44119cc1-e3fb-4eae-acec-fa431b2654f2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:21.892246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44119cc1-e3fb-4eae-acec-fa431b2654f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:21.893762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44119cc1-e3fb-4eae-acec-fa431b2654f2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:21.902811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 182/364] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:21.903619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44119cc1-e3fb-4eae-acec-fa431b2654f2 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:21.989358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 183/365] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:21.991181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2942-5dd6-4961-86f4-7241571e5501 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.025139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.043991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.050489 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44119cc1-e3fb-4eae-acec-fa431b2654f2 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.103289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d2942-5dd6-4961-86f4-7241571e5501 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.139822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7299a-1d65-4f18-92c7-7932c784414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.141135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7299a-1d65-4f18-92c7-7932c784414b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.141548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7299a-1d65-4f18-92c7-7932c784414b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.141892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7299a-1d65-4f18-92c7-7932c784414b None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.142458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff6bfc-946d-4716-8d52-51cd15c49dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.142631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7299a-1d65-4f18-92c7-7932c784414b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:22.143069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7299a-1d65-4f18-92c7-7932c784414b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.143579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff6bfc-946d-4716-8d52-51cd15c49dee None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.144135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff6bfc-946d-4716-8d52-51cd15c49dee None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.144574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfff6bfc-946d-4716-8d52-51cd15c49dee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.144681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7299a-1d65-4f18-92c7-7932c784414b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.167559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 183/366] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:22.173836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7299a-1d65-4f18-92c7-7932c784414b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.219451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff6bfc-946d-4716-8d52-51cd15c49dee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.221258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfff6bfc-946d-4716-8d52-51cd15c49dee None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.254854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.333601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 184/367] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:22.340615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff6bfc-946d-4716-8d52-51cd15c49dee None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.401724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7299a-1d65-4f18-92c7-7932c784414b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.449198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96ffe1-c17c-4a75-81a7-f884ceb5220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.449764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96ffe1-c17c-4a75-81a7-f884ceb5220e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.450034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96ffe1-c17c-4a75-81a7-f884ceb5220e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.450307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a96ffe1-c17c-4a75-81a7-f884ceb5220e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.473711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfff6bfc-946d-4716-8d52-51cd15c49dee None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.483556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.508892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.516544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4654-caae-4faf-a6cb-1c8bd71bbc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.517517 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4654-caae-4faf-a6cb-1c8bd71bbc3b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.518063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4654-caae-4faf-a6cb-1c8bd71bbc3b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.518560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fd4654-caae-4faf-a6cb-1c8bd71bbc3b None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.520026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4654-caae-4faf-a6cb-1c8bd71bbc3b None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.521723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fd4654-caae-4faf-a6cb-1c8bd71bbc3b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.524675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 185/368] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:22.526129 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4654-caae-4faf-a6cb-1c8bd71bbc3b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.545588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96ffe1-c17c-4a75-81a7-f884ceb5220e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.545588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a96ffe1-c17c-4a75-81a7-f884ceb5220e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.649773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fd4654-caae-4faf-a6cb-1c8bd71bbc3b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.659225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 184/369] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:22.660384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96ffe1-c17c-4a75-81a7-f884ceb5220e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.686388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8fe54-9b13-4033-b829-8af1c56e5325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.687716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8fe54-9b13-4033-b829-8af1c56e5325 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.688104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8fe54-9b13-4033-b829-8af1c56e5325 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.688582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c8fe54-9b13-4033-b829-8af1c56e5325 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.699310 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c8fe54-9b13-4033-b829-8af1c56e5325 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-37c8fe54-9b13-4033-b829-8af1c56e5325 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:22.705727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:22.706657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:22.707446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:22.712105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 186/370] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:22.713053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8fe54-9b13-4033-b829-8af1c56e5325 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.731496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.775044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a96ffe1-c17c-4a75-81a7-f884ceb5220e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.775829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.815195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059b56-e3dc-43fb-847c-c8f064048d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.816405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059b56-e3dc-43fb-847c-c8f064048d10 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.816964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059b56-e3dc-43fb-847c-c8f064048d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.817465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6059b56-e3dc-43fb-847c-c8f064048d10 None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.818961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6059b56-e3dc-43fb-847c-c8f064048d10 None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.820720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6059b56-e3dc-43fb-847c-c8f064048d10 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.822382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c8fe54-9b13-4033-b829-8af1c56e5325 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.822797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 185/371] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:22.823832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059b56-e3dc-43fb-847c-c8f064048d10 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.858341 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4123f5b-8704-4500-bf23-6d3115acb11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.858988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4123f5b-8704-4500-bf23-6d3115acb11c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.859879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4123f5b-8704-4500-bf23-6d3115acb11c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.860122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4123f5b-8704-4500-bf23-6d3115acb11c None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.861311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4123f5b-8704-4500-bf23-6d3115acb11c None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.862891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4123f5b-8704-4500-bf23-6d3115acb11c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.864638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 187/372] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:22.866462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4123f5b-8704-4500-bf23-6d3115acb11c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:22.943756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6059b56-e3dc-43fb-847c-c8f064048d10 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.976482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:22.982068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4123f5b-8704-4500-bf23-6d3115acb11c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:22.984823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124527-023f-4bc1-a232-0a0e5568c26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:22.985757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124527-023f-4bc1-a232-0a0e5568c26e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:22.986247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124527-023f-4bc1-a232-0a0e5568c26e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:22.986712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e124527-023f-4bc1-a232-0a0e5568c26e None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:22.987587 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e124527-023f-4bc1-a232-0a0e5568c26e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:22.988086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e124527-023f-4bc1-a232-0a0e5568c26e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:22.989693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e124527-023f-4bc1-a232-0a0e5568c26e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:22.999360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 186/373] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:23.000543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124527-023f-4bc1-a232-0a0e5568c26e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.020132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.034822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581af7d-9222-418d-a112-089227d7f4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.035749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581af7d-9222-418d-a112-089227d7f4a4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.036724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581af7d-9222-418d-a112-089227d7f4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.037200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581af7d-9222-418d-a112-089227d7f4a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.038407 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581af7d-9222-418d-a112-089227d7f4a4 None admin] RBAC: Adding query filter params (group.id=c709958a577e4a2c866ea68c1e5b32be, role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=aa0906069f964316869e9e61168bf8ac) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:23.039163 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581af7d-9222-418d-a112-089227d7f4a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.041520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581af7d-9222-418d-a112-089227d7f4a4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.050199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 188/374] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/role_assignments?group.id=c709958a577e4a2c866ea68c1e5b32be&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=165f39c0a24042fdacc0121c96347bcd => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:23.051526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581af7d-9222-418d-a112-089227d7f4a4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.143433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e124527-023f-4bc1-a232-0a0e5568c26e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.190512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76099d99-d489-42db-8377-2c2e4a14b621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.191582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099d99-d489-42db-8377-2c2e4a14b621 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.192176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099d99-d489-42db-8377-2c2e4a14b621 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.192676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76099d99-d489-42db-8377-2c2e4a14b621 None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.194405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76099d99-d489-42db-8377-2c2e4a14b621 None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.196299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76099d99-d489-42db-8377-2c2e4a14b621 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.198988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 187/375] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:22 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:23.200948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581af7d-9222-418d-a112-089227d7f4a4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.204584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76099d99-d489-42db-8377-2c2e4a14b621 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.246187 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7701cb6-dd7d-4e4a-b479-6d72eb299160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.246822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7701cb6-dd7d-4e4a-b479-6d72eb299160 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.247085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7701cb6-dd7d-4e4a-b479-6d72eb299160 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.247362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7701cb6-dd7d-4e4a-b479-6d72eb299160 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.278051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.316451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.327047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7701cb6-dd7d-4e4a-b479-6d72eb299160 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.328807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7701cb6-dd7d-4e4a-b479-6d72eb299160 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.329569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76099d99-d489-42db-8377-2c2e4a14b621 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.370763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba714f-ad5c-48ac-9f08-39125994471f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.371767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba714f-ad5c-48ac-9f08-39125994471f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.372240 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba714f-ad5c-48ac-9f08-39125994471f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.372704 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba714f-ad5c-48ac-9f08-39125994471f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.373776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba714f-ad5c-48ac-9f08-39125994471f None admin] RBAC: Adding query filter params (group.id=c709958a577e4a2c866ea68c1e5b32be, role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=aa0906069f964316869e9e61168bf8ac) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:23.374302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba714f-ad5c-48ac-9f08-39125994471f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.376616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba714f-ad5c-48ac-9f08-39125994471f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.383490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 188/376] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/role_assignments?group.id=c709958a577e4a2c866ea68c1e5b32be&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:23.385186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68e0ea-c366-4a1c-b4b6-a50e3c2b9241 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.385785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68e0ea-c366-4a1c-b4b6-a50e3c2b9241 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.386306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca68e0ea-c366-4a1c-b4b6-a50e3c2b9241 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.387910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 189/377] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:23.394954 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd386-55cd-4880-b261-6faeae54007c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.395270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd386-55cd-4880-b261-6faeae54007c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.395496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117fd386-55cd-4880-b261-6faeae54007c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.434648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-117fd386-55cd-4880-b261-6faeae54007c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:23.436233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-117fd386-55cd-4880-b261-6faeae54007c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:23.465646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 189/378] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:23.479723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7701cb6-dd7d-4e4a-b479-6d72eb299160 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.585479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 190/379] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:23.624829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.643384 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7701cb6-dd7d-4e4a-b479-6d72eb299160 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.684021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb60ab-24c9-422d-82ac-fbd7f6a0dcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.684661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb60ab-24c9-422d-82ac-fbd7f6a0dcf0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.684937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb60ab-24c9-422d-82ac-fbd7f6a0dcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.685206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfb60ab-24c9-422d-82ac-fbd7f6a0dcf0 None admin] PATH_INFO: `/v3/projects/83b1863d33eb4870a81458f19dc5d56c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.688406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb60ab-24c9-422d-82ac-fbd7f6a0dcf0 None admin] RBAC: Authorizing `identity:get_project(project_id=83b1863d33eb4870a81458f19dc5d56c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.689883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfb60ab-24c9-422d-82ac-fbd7f6a0dcf0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.691796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 190/380] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/projects/83b1863d33eb4870a81458f19dc5d56c => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:23.697183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fd386-55cd-4880-b261-6faeae54007c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.762615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:23.812742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117fd386-55cd-4880-b261-6faeae54007c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:23.849021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417a623-c377-4c9e-8c29-3249d1994ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:23.849719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417a623-c377-4c9e-8c29-3249d1994ce1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:23.849995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417a623-c377-4c9e-8c29-3249d1994ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:23.850268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417a623-c377-4c9e-8c29-3249d1994ce1 None admin] PATH_INFO: `/v3/groups/224de0f666ec478ea5d1727ffcefcc5e` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:23.856511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417a623-c377-4c9e-8c29-3249d1994ce1 None admin] RBAC: Authorizing `identity:get_group(group_id=224de0f666ec478ea5d1727ffcefcc5e)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:23.857998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d417a623-c377-4c9e-8c29-3249d1994ce1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:23.860318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 191/381] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/groups/224de0f666ec478ea5d1727ffcefcc5e => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:23.866080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb60ab-24c9-422d-82ac-fbd7f6a0dcf0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:23.895896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417a623-c377-4c9e-8c29-3249d1994ce1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.025565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d417a623-c377-4c9e-8c29-3249d1994ce1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.047542 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:24.059383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfb60ab-24c9-422d-82ac-fbd7f6a0dcf0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.078519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc5dbd-66c2-498c-b9ed-e9c4042fa358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.079174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc5dbd-66c2-498c-b9ed-e9c4042fa358 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.079455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc5dbd-66c2-498c-b9ed-e9c4042fa358 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.079729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abc5dbd-66c2-498c-b9ed-e9c4042fa358 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.106893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a78cac-083e-4583-bee5-4d3dd433680f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.107858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a78cac-083e-4583-bee5-4d3dd433680f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.108326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a78cac-083e-4583-bee5-4d3dd433680f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.108801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a78cac-083e-4583-bee5-4d3dd433680f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.109875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a78cac-083e-4583-bee5-4d3dd433680f None admin] RBAC: Adding query filter params (group.id=224de0f666ec478ea5d1727ffcefcc5e, role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=83b1863d33eb4870a81458f19dc5d56c) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:24.110380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abc5dbd-66c2-498c-b9ed-e9c4042fa358 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:24.110642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a78cac-083e-4583-bee5-4d3dd433680f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:24.112347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a78cac-083e-4583-bee5-4d3dd433680f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-8abc5dbd-66c2-498c-b9ed-e9c4042fa358 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:24.116518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:24.117469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:24.118269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:24.121612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 191/382] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/role_assignments?group.id=224de0f666ec478ea5d1727ffcefcc5e&scope.project.id=83b1863d33eb4870a81458f19dc5d56c&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 260 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:24.124444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 192/383] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:24.128387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a78cac-083e-4583-bee5-4d3dd433680f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.171779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:24.283509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a78cac-083e-4583-bee5-4d3dd433680f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.332039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa0387b-beb8-4f15-bf84-906bd8b2d99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.333008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0387b-beb8-4f15-bf84-906bd8b2d99e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.333522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0387b-beb8-4f15-bf84-906bd8b2d99e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.334008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa0387b-beb8-4f15-bf84-906bd8b2d99e None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.334888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0387b-beb8-4f15-bf84-906bd8b2d99e None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:24.335379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0387b-beb8-4f15-bf84-906bd8b2d99e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:24.336950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa0387b-beb8-4f15-bf84-906bd8b2d99e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:24.351482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 192/384] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:24.358548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc5dbd-66c2-498c-b9ed-e9c4042fa358 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.359667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68420-3c53-438d-b18a-5d1c9d2aafe0 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.359955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68420-3c53-438d-b18a-5d1c9d2aafe0 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.360228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d68420-3c53-438d-b18a-5d1c9d2aafe0 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.361880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 193/385] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:24.367326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495024ec-c961-4c63-8748-609f877d5c2d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.367607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495024ec-c961-4c63-8748-609f877d5c2d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.367885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495024ec-c961-4c63-8748-609f877d5c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.401994 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-495024ec-c961-4c63-8748-609f877d5c2d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:24.403286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-495024ec-c961-4c63-8748-609f877d5c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:24.502474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 194/386] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:24.578449 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abc5dbd-66c2-498c-b9ed-e9c4042fa358 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.618197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f75c3-3e08-48e5-bafb-7f6f15797269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.618943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f75c3-3e08-48e5-bafb-7f6f15797269 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.619108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f75c3-3e08-48e5-bafb-7f6f15797269 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.619380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f75c3-3e08-48e5-bafb-7f6f15797269 None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.620532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f75c3-3e08-48e5-bafb-7f6f15797269 None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:24.626362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f75c3-3e08-48e5-bafb-7f6f15797269 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:24.628232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 193/387] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:24 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:24.633663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495024ec-c961-4c63-8748-609f877d5c2d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.650040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:24.741422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495024ec-c961-4c63-8748-609f877d5c2d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.778042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ebf71-fb8e-4f79-a44c-149b5def48a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.778918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ebf71-fb8e-4f79-a44c-149b5def48a1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.779361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ebf71-fb8e-4f79-a44c-149b5def48a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.779780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7ebf71-fb8e-4f79-a44c-149b5def48a1 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.781653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ebf71-fb8e-4f79-a44c-149b5def48a1 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:24.783217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7ebf71-fb8e-4f79-a44c-149b5def48a1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:24.785284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 195/388] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:24 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:24.792143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f75c3-3e08-48e5-bafb-7f6f15797269 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.859711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:24.897487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ebf71-fb8e-4f79-a44c-149b5def48a1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:24.927677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f75c3-3e08-48e5-bafb-7f6f15797269 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:24.966091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c9dc3-87a7-46ed-be36-f9b60982371c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:24.966766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c9dc3-87a7-46ed-be36-f9b60982371c None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:24.967049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c9dc3-87a7-46ed-be36-f9b60982371c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:24.967327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c9dc3-87a7-46ed-be36-f9b60982371c None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/groups/c709958a577e4a2c866ea68c1e5b32be/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:24.969808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c9dc3-87a7-46ed-be36-f9b60982371c None admin] RBAC: Authorizing `identity:create_grant(project_id=03f14f0de738463fb2bbfd5a2b20739c, group_id=c709958a577e4a2c866ea68c1e5b32be, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:24.971273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c9dc3-87a7-46ed-be36-f9b60982371c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:24.989131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 194/389] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:24 2022] PUT /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/groups/c709958a577e4a2c866ea68c1e5b32be/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:25.023489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:25.054519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7ebf71-fb8e-4f79-a44c-149b5def48a1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:25.102400 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fb7ba-945b-4e67-b0c5-6bce170d110e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:25.103053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb7ba-945b-4e67-b0c5-6bce170d110e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.103330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb7ba-945b-4e67-b0c5-6bce170d110e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.103602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721fb7ba-945b-4e67-b0c5-6bce170d110e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.119252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721fb7ba-945b-4e67-b0c5-6bce170d110e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-721fb7ba-945b-4e67-b0c5-6bce170d110e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:25.124147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:25.125195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:25.126002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 196/390] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:25.134022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c9dc3-87a7-46ed-be36-f9b60982371c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:25.301312 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c9dc3-87a7-46ed-be36-f9b60982371c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:25.316860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:25.343106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153af23d-ebae-48d2-8628-65866bda15e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:25.343808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153af23d-ebae-48d2-8628-65866bda15e8 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.344098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153af23d-ebae-48d2-8628-65866bda15e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.344385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153af23d-ebae-48d2-8628-65866bda15e8 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.345069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153af23d-ebae-48d2-8628-65866bda15e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:25.345383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153af23d-ebae-48d2-8628-65866bda15e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:25.346830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153af23d-ebae-48d2-8628-65866bda15e8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:25.358037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 195/391] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:25.366486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fb7ba-945b-4e67-b0c5-6bce170d110e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:25.500363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721fb7ba-945b-4e67-b0c5-6bce170d110e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:25.540974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f8df8-9428-4681-8bd8-857405992ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:25.541645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f8df8-9428-4681-8bd8-857405992ef5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.541927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f8df8-9428-4681-8bd8-857405992ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.542203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352f8df8-9428-4681-8bd8-857405992ef5 None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.543334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f8df8-9428-4681-8bd8-857405992ef5 None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:25.544762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352f8df8-9428-4681-8bd8-857405992ef5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:25.547129 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 197/392] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:25 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:25.552830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153af23d-ebae-48d2-8628-65866bda15e8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:25.757149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153af23d-ebae-48d2-8628-65866bda15e8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:25.827958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd05a4-35fb-41f9-ac9a-09dc14b07026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:25.828606 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd05a4-35fb-41f9-ac9a-09dc14b07026 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:25.828887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd05a4-35fb-41f9-ac9a-09dc14b07026 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:25.829162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd05a4-35fb-41f9-ac9a-09dc14b07026 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:25.834073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd05a4-35fb-41f9-ac9a-09dc14b07026 None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:25.835543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd05a4-35fb-41f9-ac9a-09dc14b07026 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:25.837518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 196/393] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:25 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:25.843386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f8df8-9428-4681-8bd8-857405992ef5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:25.865796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.010460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352f8df8-9428-4681-8bd8-857405992ef5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.057066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173e8678-c815-47d9-81f6-40e5dae42d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.057785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8678-c815-47d9-81f6-40e5dae42d04 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.058068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8678-c815-47d9-81f6-40e5dae42d04 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.058343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173e8678-c815-47d9-81f6-40e5dae42d04 None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/groups/c709958a577e4a2c866ea68c1e5b32be/roles/1f5abd9c8afd411ebac7cd79bb5f1230` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.063565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e8678-c815-47d9-81f6-40e5dae42d04 None admin] RBAC: Authorizing `identity:create_grant(project_id=03f14f0de738463fb2bbfd5a2b20739c, group_id=c709958a577e4a2c866ea68c1e5b32be, role_id=1f5abd9c8afd411ebac7cd79bb5f1230)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:26.065052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173e8678-c815-47d9-81f6-40e5dae42d04 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:26.087802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 198/394] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:25 2022] PUT /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c/groups/c709958a577e4a2c866ea68c1e5b32be/roles/1f5abd9c8afd411ebac7cd79bb5f1230 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:26.170969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df950-1c7c-46bd-bccd-a900005ec188 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.171298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df950-1c7c-46bd-bccd-a900005ec188 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.171611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df950-1c7c-46bd-bccd-a900005ec188 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.173238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 197/395] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:26.178429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499fc5-0449-479f-b686-275b3e953a22 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.178710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499fc5-0449-479f-b686-275b3e953a22 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.178982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f499fc5-0449-479f-b686-275b3e953a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.201512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0f499fc5-0449-479f-b686-275b3e953a22 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:26.202810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0f499fc5-0449-479f-b686-275b3e953a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:26.290364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.295148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 199/396] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:26.337426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235db98-19a3-42de-a3d8-059a64ac58e6 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.337767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235db98-19a3-42de-a3d8-059a64ac58e6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.337990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6235db98-19a3-42de-a3d8-059a64ac58e6 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.339603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 198/397] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:26.351328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612333-9b90-42ae-8ebc-ebaa90226eb5 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.351639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612333-9b90-42ae-8ebc-ebaa90226eb5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.351875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612333-9b90-42ae-8ebc-ebaa90226eb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.378469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6d612333-9b90-42ae-8ebc-ebaa90226eb5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:26.379659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6d612333-9b90-42ae-8ebc-ebaa90226eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:26.465871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 200/398] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:26.632093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235db98-19a3-42de-a3d8-059a64ac58e6 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.678049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.761136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6235db98-19a3-42de-a3d8-059a64ac58e6 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.804265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894995d7-7778-4a6f-a008-80944238f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.804914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894995d7-7778-4a6f-a008-80944238f13c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.805203 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894995d7-7778-4a6f-a008-80944238f13c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.805510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894995d7-7778-4a6f-a008-80944238f13c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.817302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894995d7-7778-4a6f-a008-80944238f13c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-894995d7-7778-4a6f-a008-80944238f13c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:26.822308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:26.823154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:26.823940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:26.828883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 199/399] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:26.830235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d612333-9b90-42ae-8ebc-ebaa90226eb5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.837317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894995d7-7778-4a6f-a008-80944238f13c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:26.954749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d612333-9b90-42ae-8ebc-ebaa90226eb5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.957812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.967947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894995d7-7778-4a6f-a008-80944238f13c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:26.988076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:26.996021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f0619-36aa-4a86-bf5f-73a1c2e3f0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:26.996643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f0619-36aa-4a86-bf5f-73a1c2e3f0a9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:26.996925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f0619-36aa-4a86-bf5f-73a1c2e3f0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:26.997199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f0619-36aa-4a86-bf5f-73a1c2e3f0a9 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:26.997928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f0619-36aa-4a86-bf5f-73a1c2e3f0a9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:26.998231 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f0619-36aa-4a86-bf5f-73a1c2e3f0a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.000547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f0619-36aa-4a86-bf5f-73a1c2e3f0a9 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.010400 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 201/400] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:27.018788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f0619-36aa-4a86-bf5f-73a1c2e3f0a9 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.082742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a60ef-e5e1-4c7a-a65b-8c8c9ae9c976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.083404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a60ef-e5e1-4c7a-a65b-8c8c9ae9c976 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.083694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a60ef-e5e1-4c7a-a65b-8c8c9ae9c976 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.083968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739a60ef-e5e1-4c7a-a65b-8c8c9ae9c976 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.118497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739a60ef-e5e1-4c7a-a65b-8c8c9ae9c976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-739a60ef-e5e1-4c7a-a65b-8c8c9ae9c976 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:27.123996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:27.125480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:27.126282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 200/401] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:27.134683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a60ef-e5e1-4c7a-a65b-8c8c9ae9c976 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.178746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f0619-36aa-4a86-bf5f-73a1c2e3f0a9 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.215891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20b24e-bd01-4d77-bcf0-1f6a6ac2384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.217029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b24e-bd01-4d77-bcf0-1f6a6ac2384d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.217549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b24e-bd01-4d77-bcf0-1f6a6ac2384d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.218013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20b24e-bd01-4d77-bcf0-1f6a6ac2384d None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.219970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b24e-bd01-4d77-bcf0-1f6a6ac2384d None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.221651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20b24e-bd01-4d77-bcf0-1f6a6ac2384d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.223721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 202/402] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:27.225056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17d96b-c6ff-4272-9537-c1074d24c9dc None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.225556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17d96b-c6ff-4272-9537-c1074d24c9dc None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.226037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17d96b-c6ff-4272-9537-c1074d24c9dc None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.227448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 203/403] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:27.231036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17d96b-c6ff-4272-9537-c1074d24c9dc None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.286395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739a60ef-e5e1-4c7a-a65b-8c8c9ae9c976 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.327439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.339636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc25b0-3088-459c-b478-ece4a81bcbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.340637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc25b0-3088-459c-b478-ece4a81bcbfa None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.341598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc25b0-3088-459c-b478-ece4a81bcbfa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.342127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc25b0-3088-459c-b478-ece4a81bcbfa None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.343216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc25b0-3088-459c-b478-ece4a81bcbfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:27.343741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc25b0-3088-459c-b478-ece4a81bcbfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.346182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc25b0-3088-459c-b478-ece4a81bcbfa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.358739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 201/404] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:27.361967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af672557-101a-4859-87bb-85b3798c28dc None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.362520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af672557-101a-4859-87bb-85b3798c28dc None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.363519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af672557-101a-4859-87bb-85b3798c28dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.386222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-af672557-101a-4859-87bb-85b3798c28dc None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:27.387432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-af672557-101a-4859-87bb-85b3798c28dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:27.390062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17d96b-c6ff-4272-9537-c1074d24c9dc None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.410878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.441265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad130c32-6b8a-4afe-933e-0d657ab134da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.441940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad130c32-6b8a-4afe-933e-0d657ab134da None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.442586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad130c32-6b8a-4afe-933e-0d657ab134da None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.442872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad130c32-6b8a-4afe-933e-0d657ab134da None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.444444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad130c32-6b8a-4afe-933e-0d657ab134da None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.446238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad130c32-6b8a-4afe-933e-0d657ab134da None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.448646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 204/405] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:27.449523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad130c32-6b8a-4afe-933e-0d657ab134da None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.480311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 202/406] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:27.481129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af672557-101a-4859-87bb-85b3798c28dc None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.597923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af672557-101a-4859-87bb-85b3798c28dc None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.638452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65311938-cb96-41de-953f-4f64dfcada93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.639289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65311938-cb96-41de-953f-4f64dfcada93 None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.639579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65311938-cb96-41de-953f-4f64dfcada93 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.639860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65311938-cb96-41de-953f-4f64dfcada93 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac/groups/c709958a577e4a2c866ea68c1e5b32be/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.644452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65311938-cb96-41de-953f-4f64dfcada93 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa0906069f964316869e9e61168bf8ac, group_id=c709958a577e4a2c866ea68c1e5b32be, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.645937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65311938-cb96-41de-953f-4f64dfcada93 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.666824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 203/407] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:27 2022] PUT /identity/v3/projects/aa0906069f964316869e9e61168bf8ac/groups/c709958a577e4a2c866ea68c1e5b32be/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:27.683611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad130c32-6b8a-4afe-933e-0d657ab134da None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.730576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.742890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8f255-3fa9-4388-bcc8-e86d7632b9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.743551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8f255-3fa9-4388-bcc8-e86d7632b9b8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.743829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8f255-3fa9-4388-bcc8-e86d7632b9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.744100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8f255-3fa9-4388-bcc8-e86d7632b9b8 None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.746569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8f255-3fa9-4388-bcc8-e86d7632b9b8 None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.748060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8f255-3fa9-4388-bcc8-e86d7632b9b8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.750346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 205/408] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:27.755880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65311938-cb96-41de-953f-4f64dfcada93 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.767328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:27.836076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4637f-87c3-41ed-bb01-a88eb2d14cff None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.836388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4637f-87c3-41ed-bb01-a88eb2d14cff None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.836610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4637f-87c3-41ed-bb01-a88eb2d14cff None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.838107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 206/409] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:27.838918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4637f-87c3-41ed-bb01-a88eb2d14cff None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:27.900435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65311938-cb96-41de-953f-4f64dfcada93 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.940590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94807cde-1ab6-4003-887d-505cf5f2edf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:27.941689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94807cde-1ab6-4003-887d-505cf5f2edf1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.942178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94807cde-1ab6-4003-887d-505cf5f2edf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.942644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94807cde-1ab6-4003-887d-505cf5f2edf1 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.943961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94807cde-1ab6-4003-887d-505cf5f2edf1 None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:27.946283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94807cde-1ab6-4003-887d-505cf5f2edf1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:27.948400 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 204/410] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:27.949730 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b921b8-9c93-4632-8ab6-3174a2660d4e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:27.950186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b921b8-9c93-4632-8ab6-3174a2660d4e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:27.950619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b921b8-9c93-4632-8ab6-3174a2660d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:27.972765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4637f-87c3-41ed-bb01-a88eb2d14cff None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:27.973458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-96b921b8-9c93-4632-8ab6-3174a2660d4e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:27.974616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-96b921b8-9c93-4632-8ab6-3174a2660d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:28.014823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bd084-8bcd-4354-ab0b-287d8755780f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.016533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bd084-8bcd-4354-ab0b-287d8755780f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.017024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bd084-8bcd-4354-ab0b-287d8755780f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.017546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434bd084-8bcd-4354-ab0b-287d8755780f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.028669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434bd084-8bcd-4354-ab0b-287d8755780f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-434bd084-8bcd-4354-ab0b-287d8755780f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:28.034542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:28.035406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:28.036226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:28.038506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 207/411] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:28.039474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bd084-8bcd-4354-ab0b-287d8755780f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.073454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 205/412] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:28.073454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b921b8-9c93-4632-8ab6-3174a2660d4e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.079589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:28.131879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:28.221587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434bd084-8bcd-4354-ab0b-287d8755780f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.222931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b921b8-9c93-4632-8ab6-3174a2660d4e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.272326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926293f-c45b-446c-a4cd-92f2405ab8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.273040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926293f-c45b-446c-a4cd-92f2405ab8d0 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.273320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926293f-c45b-446c-a4cd-92f2405ab8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.273644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3926293f-c45b-446c-a4cd-92f2405ab8d0 None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac/groups/c709958a577e4a2c866ea68c1e5b32be/roles/1f5abd9c8afd411ebac7cd79bb5f1230` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.276083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926293f-c45b-446c-a4cd-92f2405ab8d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa0906069f964316869e9e61168bf8ac, group_id=c709958a577e4a2c866ea68c1e5b32be, role_id=1f5abd9c8afd411ebac7cd79bb5f1230)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.277551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3926293f-c45b-446c-a4cd-92f2405ab8d0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.296947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 208/413] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:28 2022] PUT /identity/v3/projects/aa0906069f964316869e9e61168bf8ac/groups/c709958a577e4a2c866ea68c1e5b32be/roles/1f5abd9c8afd411ebac7cd79bb5f1230 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:28.302205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713f831-2da4-419f-8929-922bc18840a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.302840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f831-2da4-419f-8929-922bc18840a5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.303111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f831-2da4-419f-8929-922bc18840a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.303378 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713f831-2da4-419f-8929-922bc18840a5 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.304061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713f831-2da4-419f-8929-922bc18840a5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:28.304362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713f831-2da4-419f-8929-922bc18840a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.305818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7713f831-2da4-419f-8929-922bc18840a5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.315772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 206/414] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:28.321344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926293f-c45b-446c-a4cd-92f2405ab8d0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.395959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713f831-2da4-419f-8929-922bc18840a5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.469149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3926293f-c45b-446c-a4cd-92f2405ab8d0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.488880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:28.514125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75224ae4-e7a4-499d-8859-7ad9d7855db4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.514773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75224ae4-e7a4-499d-8859-7ad9d7855db4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.515057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75224ae4-e7a4-499d-8859-7ad9d7855db4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.515960 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75224ae4-e7a4-499d-8859-7ad9d7855db4 None admin] PATH_INFO: `/v3/groups/224de0f666ec478ea5d1727ffcefcc5e` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.517612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75224ae4-e7a4-499d-8859-7ad9d7855db4 None admin] RBAC: Authorizing `identity:get_group(group_id=224de0f666ec478ea5d1727ffcefcc5e)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.519073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75224ae4-e7a4-499d-8859-7ad9d7855db4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.521046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 209/415] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:28 2022] GET /identity/v3/groups/224de0f666ec478ea5d1727ffcefcc5e => generated 229 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:28.526777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75224ae4-e7a4-499d-8859-7ad9d7855db4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.554271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:28.614421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713f831-2da4-419f-8929-922bc18840a5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.684912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b0d6b-c0c4-4ff2-8936-7229300fad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.685586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b0d6b-c0c4-4ff2-8936-7229300fad06 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.688836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b0d6b-c0c4-4ff2-8936-7229300fad06 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.689115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b0d6b-c0c4-4ff2-8936-7229300fad06 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.701107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75224ae4-e7a4-499d-8859-7ad9d7855db4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.712581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b0d6b-c0c4-4ff2-8936-7229300fad06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-ff6b0d6b-c0c4-4ff2-8936-7229300fad06 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:28.722736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:28.723616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:28.724403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 207/416] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:28.729970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b0d6b-c0c4-4ff2-8936-7229300fad06 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.773872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea096a28-a867-419a-b5bd-23029e1d4f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.774942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096a28-a867-419a-b5bd-23029e1d4f6d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.775536 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096a28-a867-419a-b5bd-23029e1d4f6d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.776067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea096a28-a867-419a-b5bd-23029e1d4f6d None admin] PATH_INFO: `/v3/projects/83b1863d33eb4870a81458f19dc5d56c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.782533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea096a28-a867-419a-b5bd-23029e1d4f6d None admin] RBAC: Authorizing `identity:get_project(project_id=83b1863d33eb4870a81458f19dc5d56c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.784571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea096a28-a867-419a-b5bd-23029e1d4f6d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.786996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 210/417] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:28 2022] GET /identity/v3/projects/83b1863d33eb4870a81458f19dc5d56c => generated 344 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:28.793171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea096a28-a867-419a-b5bd-23029e1d4f6d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.854834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b0d6b-c0c4-4ff2-8936-7229300fad06 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:28.874242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:28.890286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:28.899307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6887d-6b14-4da1-ad4c-3e1478c90c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:28.900326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6887d-6b14-4da1-ad4c-3e1478c90c2e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:28.900894 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6887d-6b14-4da1-ad4c-3e1478c90c2e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:28.901343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb6887d-6b14-4da1-ad4c-3e1478c90c2e None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:28.902480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6887d-6b14-4da1-ad4c-3e1478c90c2e None admin] RBAC: Adding query filter params (name=member) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:28.902962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6887d-6b14-4da1-ad4c-3e1478c90c2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:28.904594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb6887d-6b14-4da1-ad4c-3e1478c90c2e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:28.915468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 208/418] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:28.922012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6887d-6b14-4da1-ad4c-3e1478c90c2e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:28.987178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea096a28-a867-419a-b5bd-23029e1d4f6d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:29.023966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f0f7f-e081-4a8b-8b8c-c53378835831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:29.024586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f0f7f-e081-4a8b-8b8c-c53378835831 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.024863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f0f7f-e081-4a8b-8b8c-c53378835831 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.025133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f0f7f-e081-4a8b-8b8c-c53378835831 None admin] PATH_INFO: `/v3/projects/83b1863d33eb4870a81458f19dc5d56c/groups/224de0f666ec478ea5d1727ffcefcc5e/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.027387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f0f7f-e081-4a8b-8b8c-c53378835831 None admin] RBAC: Authorizing `identity:create_grant(project_id=83b1863d33eb4870a81458f19dc5d56c, group_id=224de0f666ec478ea5d1727ffcefcc5e, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:29.028806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0f0f7f-e081-4a8b-8b8c-c53378835831 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:29.044046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb6887d-6b14-4da1-ad4c-3e1478c90c2e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:29.044312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 211/419] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 17 00:35:28 2022] PUT /identity/v3/projects/83b1863d33eb4870a81458f19dc5d56c/groups/224de0f666ec478ea5d1727ffcefcc5e/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:35:29.051511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea343e-aa47-4edc-a4ca-fdfd4e23f48b None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.051830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea343e-aa47-4edc-a4ca-fdfd4e23f48b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.052209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea343e-aa47-4edc-a4ca-fdfd4e23f48b None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.058283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 212/420] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:29.070974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25c504-2353-46c4-a64f-fc42823bb888 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.071309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25c504-2353-46c4-a64f-fc42823bb888 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.071504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25c504-2353-46c4-a64f-fc42823bb888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.090150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303536f-fffb-4316-b0c0-ec4956ba0c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:29.096393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303536f-fffb-4316-b0c0-ec4956ba0c9c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.097012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303536f-fffb-4316-b0c0-ec4956ba0c9c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.097523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7303536f-fffb-4316-b0c0-ec4956ba0c9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.119041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-1e25c504-2353-46c4-a64f-fc42823bb888 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:29.120262 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1e25c504-2353-46c4-a64f-fc42823bb888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:29.204514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:29.223965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303536f-fffb-4316-b0c0-ec4956ba0c9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:29.225504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7303536f-fffb-4316-b0c0-ec4956ba0c9c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:29.261547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 213/421] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:29.365442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 209/422] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 00:35:29.373822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25c504-2353-46c4-a64f-fc42823bb888 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:29.427024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:29.509914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25c504-2353-46c4-a64f-fc42823bb888 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:29.556858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23754ff6-0b42-433f-b58d-29ecb560186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:29.557547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754ff6-0b42-433f-b58d-29ecb560186e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.557831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754ff6-0b42-433f-b58d-29ecb560186e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.558107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23754ff6-0b42-433f-b58d-29ecb560186e None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.562155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23754ff6-0b42-433f-b58d-29ecb560186e None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:29.563614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23754ff6-0b42-433f-b58d-29ecb560186e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:29.565636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 214/423] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:29 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:29.570949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303536f-fffb-4316-b0c0-ec4956ba0c9c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:29.589675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23754ff6-0b42-433f-b58d-29ecb560186e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:29.725850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:29.727565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23754ff6-0b42-433f-b58d-29ecb560186e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:29.743326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7303536f-fffb-4316-b0c0-ec4956ba0c9c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:29.748597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:29.792351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1971c3-5343-4867-9aeb-47963afdf0d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:29.793357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1971c3-5343-4867-9aeb-47963afdf0d9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.793874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1971c3-5343-4867-9aeb-47963afdf0d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.794369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1971c3-5343-4867-9aeb-47963afdf0d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.801644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19999d88-0549-434b-80a3-8b545d1d8dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:29.802283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19999d88-0549-434b-80a3-8b545d1d8dfb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:29.802558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19999d88-0549-434b-80a3-8b545d1d8dfb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:29.802843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19999d88-0549-434b-80a3-8b545d1d8dfb None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:29.803959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19999d88-0549-434b-80a3-8b545d1d8dfb None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:29.809442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19999d88-0549-434b-80a3-8b545d1d8dfb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:29.809442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 210/424] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:29 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:29.812902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19999d88-0549-434b-80a3-8b545d1d8dfb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:29.822060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1971c3-5343-4867-9aeb-47963afdf0d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-fd1971c3-5343-4867-9aeb-47963afdf0d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:29.826993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:29.828404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:29.829217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:29.835743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 215/425] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:29.836870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1971c3-5343-4867-9aeb-47963afdf0d9 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:29.950079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19999d88-0549-434b-80a3-8b545d1d8dfb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.009456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4451d54-436a-46a1-ae8f-6090fe76964a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.010088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4451d54-436a-46a1-ae8f-6090fe76964a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.010366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4451d54-436a-46a1-ae8f-6090fe76964a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.010639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4451d54-436a-46a1-ae8f-6090fe76964a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.011366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4451d54-436a-46a1-ae8f-6090fe76964a None admin] RBAC: Adding query filter params (group.id=c709958a577e4a2c866ea68c1e5b32be, role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:30.011670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4451d54-436a-46a1-ae8f-6090fe76964a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:30.013222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4451d54-436a-46a1-ae8f-6090fe76964a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:30.025466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 211/426] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:29 2022] GET /identity/v3/role_assignments?group.id=c709958a577e4a2c866ea68c1e5b32be&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=165f39c0a24042fdacc0121c96347bcd => generated 611 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:30.044574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1971c3-5343-4867-9aeb-47963afdf0d9 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.081928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e23a96-5eba-4666-8f0b-682331ea1a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.082565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23a96-5eba-4666-8f0b-682331ea1a84 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.082843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23a96-5eba-4666-8f0b-682331ea1a84 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.083115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e23a96-5eba-4666-8f0b-682331ea1a84 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.083890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e23a96-5eba-4666-8f0b-682331ea1a84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:30.084191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e23a96-5eba-4666-8f0b-682331ea1a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:30.085649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e23a96-5eba-4666-8f0b-682331ea1a84 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:30.096364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 216/427] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:30.102149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4451d54-436a-46a1-ae8f-6090fe76964a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.132246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.231016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4451d54-436a-46a1-ae8f-6090fe76964a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.257322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb1888-e147-4f4b-82ff-07ddf3518c39 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.257695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb1888-e147-4f4b-82ff-07ddf3518c39 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.257902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb1888-e147-4f4b-82ff-07ddf3518c39 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.259615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 217/428] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:30.265496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6bbc9-b37c-491d-9208-07aaeb239ddb None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.265815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6bbc9-b37c-491d-9208-07aaeb239ddb None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.266035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6bbc9-b37c-491d-9208-07aaeb239ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.283078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174b8a0-0793-4e43-bab8-7d4785a34389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.283710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174b8a0-0793-4e43-bab8-7d4785a34389 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.283996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174b8a0-0793-4e43-bab8-7d4785a34389 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.284273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174b8a0-0793-4e43-bab8-7d4785a34389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.290240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8ed6bbc9-b37c-491d-9208-07aaeb239ddb None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:30.291444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8ed6bbc9-b37c-491d-9208-07aaeb239ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:30.325830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.367332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174b8a0-0793-4e43-bab8-7d4785a34389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:30.369377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174b8a0-0793-4e43-bab8-7d4785a34389 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:30.376113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 218/429] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:30.402598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.514600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 212/430] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 00:35:30.521105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6bbc9-b37c-491d-9208-07aaeb239ddb None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.631681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6bbc9-b37c-491d-9208-07aaeb239ddb None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.667190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de01adb-9ff5-4bd1-888a-63b4cb7435ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.667826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01adb-9ff5-4bd1-888a-63b4cb7435ab None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.668162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01adb-9ff5-4bd1-888a-63b4cb7435ab None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.668374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de01adb-9ff5-4bd1-888a-63b4cb7435ab None admin] PATH_INFO: `/v3/projects/03f14f0de738463fb2bbfd5a2b20739c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.669525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de01adb-9ff5-4bd1-888a-63b4cb7435ab None admin] RBAC: Authorizing `identity:get_project(project_id=03f14f0de738463fb2bbfd5a2b20739c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:30.670941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de01adb-9ff5-4bd1-888a-63b4cb7435ab None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:30.673055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 219/431] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/projects/03f14f0de738463fb2bbfd5a2b20739c => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:30.678506 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174b8a0-0793-4e43-bab8-7d4785a34389 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.714011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de01adb-9ff5-4bd1-888a-63b4cb7435ab None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.753840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.828399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174b8a0-0793-4e43-bab8-7d4785a34389 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.841015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de01adb-9ff5-4bd1-888a-63b4cb7435ab None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:30.861588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:30.876094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f30b8-de7b-42dc-9230-3682fb65842f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.876747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f30b8-de7b-42dc-9230-3682fb65842f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.877029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f30b8-de7b-42dc-9230-3682fb65842f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.877310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97f30b8-de7b-42dc-9230-3682fb65842f None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.878483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f30b8-de7b-42dc-9230-3682fb65842f None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:30.879949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97f30b8-de7b-42dc-9230-3682fb65842f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:30.882430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 213/432] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:30.888937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f30b8-de7b-42dc-9230-3682fb65842f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:30.892908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdde9829-cf95-42de-8b7b-1916c8242857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:30.893606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9829-cf95-42de-8b7b-1916c8242857 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.895935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9829-cf95-42de-8b7b-1916c8242857 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.895935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdde9829-cf95-42de-8b7b-1916c8242857 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.912553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdde9829-cf95-42de-8b7b-1916c8242857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-bdde9829-cf95-42de-8b7b-1916c8242857 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:30.918347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:30.919207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:30.919991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 220/433] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:30.921072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc0c71-c568-441f-948e-dc6f9e4d03b4 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:30.921225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc0c71-c568-441f-948e-dc6f9e4d03b4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:30.921579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cc0c71-c568-441f-948e-dc6f9e4d03b4 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:30.922821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 221/434] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:30.927287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc0c71-c568-441f-948e-dc6f9e4d03b4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.017328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97f30b8-de7b-42dc-9230-3682fb65842f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.042384 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.055336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cc0c71-c568-441f-948e-dc6f9e4d03b4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.061513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0973d-7f81-4f44-8ce3-7054bf34812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.062693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0973d-7f81-4f44-8ce3-7054bf34812a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.062970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0973d-7f81-4f44-8ce3-7054bf34812a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.063645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0973d-7f81-4f44-8ce3-7054bf34812a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.064380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0973d-7f81-4f44-8ce3-7054bf34812a None admin] RBAC: Adding query filter params (group.id=c709958a577e4a2c866ea68c1e5b32be, role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=03f14f0de738463fb2bbfd5a2b20739c) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:31.064687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0973d-7f81-4f44-8ce3-7054bf34812a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.066512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0973d-7f81-4f44-8ce3-7054bf34812a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.080905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 214/435] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/role_assignments?group.id=c709958a577e4a2c866ea68c1e5b32be&scope.project.id=03f14f0de738463fb2bbfd5a2b20739c&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:31.080905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819d555-a789-44fb-9656-db784a232afe None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.080905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819d555-a789-44fb-9656-db784a232afe None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.080905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7819d555-a789-44fb-9656-db784a232afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.095803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7819d555-a789-44fb-9656-db784a232afe None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:31.097831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7819d555-a789-44fb-9656-db784a232afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:31.105572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f77bd6-c3dc-40e0-a015-33d35550d0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.106208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f77bd6-c3dc-40e0-a015-33d35550d0b8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.106490 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f77bd6-c3dc-40e0-a015-33d35550d0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.106765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f77bd6-c3dc-40e0-a015-33d35550d0b8 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.108234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f77bd6-c3dc-40e0-a015-33d35550d0b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:31.108541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f77bd6-c3dc-40e0-a015-33d35550d0b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.111108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f77bd6-c3dc-40e0-a015-33d35550d0b8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.122856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 222/436] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:35:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:31.128336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f77bd6-c3dc-40e0-a015-33d35550d0b8 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.169959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.197206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 215/437] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:31.257923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f77bd6-c3dc-40e0-a015-33d35550d0b8 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.292238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c22a-864a-4b9c-97f7-fb4bb51866bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.292915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c22a-864a-4b9c-97f7-fb4bb51866bd None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.293206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c22a-864a-4b9c-97f7-fb4bb51866bd None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.295248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1501c22a-864a-4b9c-97f7-fb4bb51866bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.321947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.372349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c22a-864a-4b9c-97f7-fb4bb51866bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.373758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1501c22a-864a-4b9c-97f7-fb4bb51866bd None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.475201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819d555-a789-44fb-9656-db784a232afe None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.490800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 223/438] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:31.496749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c22a-864a-4b9c-97f7-fb4bb51866bd None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.559646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.602975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7819d555-a789-44fb-9656-db784a232afe None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.617654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1501c22a-864a-4b9c-97f7-fb4bb51866bd None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.639132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26d73f-1eda-46b5-bcfd-f02118e9e469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.639677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d73f-1eda-46b5-bcfd-f02118e9e469 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.639953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d73f-1eda-46b5-bcfd-f02118e9e469 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.640259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26d73f-1eda-46b5-bcfd-f02118e9e469 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.651397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26d73f-1eda-46b5-bcfd-f02118e9e469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:31.652505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200c525-6406-4d89-a7c3-192e142acc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.653130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c525-6406-4d89-a7c3-192e142acc5f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.653422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c525-6406-4d89-a7c3-192e142acc5f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.653701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3200c525-6406-4d89-a7c3-192e142acc5f None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.654812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200c525-6406-4d89-a7c3-192e142acc5f None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-9d26d73f-1eda-46b5-bcfd-f02118e9e469 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:31.656682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:31.657788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:31.658634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:31.659237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3200c525-6406-4d89-a7c3-192e142acc5f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.659304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 216/439] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:31.663151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 224/440] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:31.663746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26d73f-1eda-46b5-bcfd-f02118e9e469 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.668399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200c525-6406-4d89-a7c3-192e142acc5f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.710535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.763594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26d73f-1eda-46b5-bcfd-f02118e9e469 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.764787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3200c525-6406-4d89-a7c3-192e142acc5f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.784148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.798215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508590c-82d1-4d7d-b13c-de2ba88725bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.798826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508590c-82d1-4d7d-b13c-de2ba88725bf None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.799139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692d98a-eea2-46b7-9115-ae35f79913e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.799269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508590c-82d1-4d7d-b13c-de2ba88725bf None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.799430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508590c-82d1-4d7d-b13c-de2ba88725bf None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.799756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d98a-eea2-46b7-9115-ae35f79913e3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.800033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d98a-eea2-46b7-9115-ae35f79913e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.800125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508590c-82d1-4d7d-b13c-de2ba88725bf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:31.800305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692d98a-eea2-46b7-9115-ae35f79913e3 None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.800399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508590c-82d1-4d7d-b13c-de2ba88725bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.801428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692d98a-eea2-46b7-9115-ae35f79913e3 None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.801837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508590c-82d1-4d7d-b13c-de2ba88725bf None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.802862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692d98a-eea2-46b7-9115-ae35f79913e3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.804417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 225/441] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:31.805613 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910dde5-567b-4c95-bb21-0167e0f229b4 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.805895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910dde5-567b-4c95-bb21-0167e0f229b4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.806166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910dde5-567b-4c95-bb21-0167e0f229b4 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.809441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 226/442] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:31.810047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 217/443] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:31.810150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910dde5-567b-4c95-bb21-0167e0f229b4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.815444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508590c-82d1-4d7d-b13c-de2ba88725bf None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:31.911114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910dde5-567b-4c95-bb21-0167e0f229b4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.913645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508590c-82d1-4d7d-b13c-de2ba88725bf None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:31.920156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:31.944726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74e3c4-2f78-4b3e-bfeb-62f532be46d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.945327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74e3c4-2f78-4b3e-bfeb-62f532be46d5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.945650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74e3c4-2f78-4b3e-bfeb-62f532be46d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.945926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74e3c4-2f78-4b3e-bfeb-62f532be46d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.946652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74e3c4-2f78-4b3e-bfeb-62f532be46d5 None admin] RBAC: Adding query filter params (group.id=c709958a577e4a2c866ea68c1e5b32be, role.id=165f39c0a24042fdacc0121c96347bcd, scope.project.id=aa0906069f964316869e9e61168bf8ac) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:31.946965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74e3c4-2f78-4b3e-bfeb-62f532be46d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:31.947541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc638ff0-f2eb-46f6-ac4e-7e743cb40505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:31.948167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc638ff0-f2eb-46f6-ac4e-7e743cb40505 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.948410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74e3c4-2f78-4b3e-bfeb-62f532be46d5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:31.948501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc638ff0-f2eb-46f6-ac4e-7e743cb40505 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.948776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc638ff0-f2eb-46f6-ac4e-7e743cb40505 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.954999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 227/444] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/role_assignments?group.id=c709958a577e4a2c866ea68c1e5b32be&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=165f39c0a24042fdacc0121c96347bcd => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:31.958734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bd25d-e808-4b54-8290-7dac2ff60d18 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:31.959016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bd25d-e808-4b54-8290-7dac2ff60d18 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:31.959288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bd25d-e808-4b54-8290-7dac2ff60d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:31.979476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-398bd25d-e808-4b54-8290-7dac2ff60d18 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:31.980721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-398bd25d-e808-4b54-8290-7dac2ff60d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:32.034809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc638ff0-f2eb-46f6-ac4e-7e743cb40505 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.036297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.037014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc638ff0-f2eb-46f6-ac4e-7e743cb40505 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.059523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 228/445] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:32.151207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 218/446] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 17 00:35:32.157070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bd25d-e808-4b54-8290-7dac2ff60d18 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.260909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bd25d-e808-4b54-8290-7dac2ff60d18 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.297322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4787ed-0e17-429c-9a7c-9c83cc0b8f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.298003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4787ed-0e17-429c-9a7c-9c83cc0b8f9b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.298282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4787ed-0e17-429c-9a7c-9c83cc0b8f9b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.298556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4787ed-0e17-429c-9a7c-9c83cc0b8f9b None admin] PATH_INFO: `/v3/projects/aa0906069f964316869e9e61168bf8ac` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.299771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4787ed-0e17-429c-9a7c-9c83cc0b8f9b None admin] RBAC: Authorizing `identity:get_project(project_id=aa0906069f964316869e9e61168bf8ac)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.301351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4787ed-0e17-429c-9a7c-9c83cc0b8f9b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.303021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 229/447] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/projects/aa0906069f964316869e9e61168bf8ac => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:32.308604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc638ff0-f2eb-46f6-ac4e-7e743cb40505 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.317164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.334492 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4787ed-0e17-429c-9a7c-9c83cc0b8f9b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.388363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.416422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc638ff0-f2eb-46f6-ac4e-7e743cb40505 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.440771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4787ed-0e17-429c-9a7c-9c83cc0b8f9b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.450664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a09a2d-654c-4053-9d8c-f378ea2aed36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.451313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a09a2d-654c-4053-9d8c-f378ea2aed36 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.451623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a09a2d-654c-4053-9d8c-f378ea2aed36 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.451955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a09a2d-654c-4053-9d8c-f378ea2aed36 None admin] PATH_INFO: `/v3/groups/c709958a577e4a2c866ea68c1e5b32be` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.453498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a09a2d-654c-4053-9d8c-f378ea2aed36 None admin] RBAC: Authorizing `identity:get_group(group_id=c709958a577e4a2c866ea68c1e5b32be)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.454971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a09a2d-654c-4053-9d8c-f378ea2aed36 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.456546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 219/448] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/groups/c709958a577e4a2c866ea68c1e5b32be => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:32.462363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a09a2d-654c-4053-9d8c-f378ea2aed36 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.475157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850aac0-0966-47a5-af57-b1421b75cc49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.475781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850aac0-0966-47a5-af57-b1421b75cc49 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.476062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850aac0-0966-47a5-af57-b1421b75cc49 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.476336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3850aac0-0966-47a5-af57-b1421b75cc49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.486215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3850aac0-0966-47a5-af57-b1421b75cc49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-3850aac0-0966-47a5-af57-b1421b75cc49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:32.490996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:32.492062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:32.492839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 230/449] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:32.497677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850aac0-0966-47a5-af57-b1421b75cc49 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.538233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.564576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a09a2d-654c-4053-9d8c-f378ea2aed36 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.596405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3850aac0-0966-47a5-af57-b1421b75cc49 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.599481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad6d4-4897-4da2-a83b-4e077de62c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.600096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad6d4-4897-4da2-a83b-4e077de62c75 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.600413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad6d4-4897-4da2-a83b-4e077de62c75 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.600721 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad6d4-4897-4da2-a83b-4e077de62c75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.601593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cad6d4-4897-4da2-a83b-4e077de62c75 None admin] RBAC: Adding query filter params (group.id=c709958a577e4a2c866ea68c1e5b32be, role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=aa0906069f964316869e9e61168bf8ac) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:32.601923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cad6d4-4897-4da2-a83b-4e077de62c75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.603491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cad6d4-4897-4da2-a83b-4e077de62c75 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.606705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.609751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 220/450] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/role_assignments?group.id=c709958a577e4a2c866ea68c1e5b32be&scope.project.id=aa0906069f964316869e9e61168bf8ac&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:32.631064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81167162-af70-497e-83e3-b2116688d909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.631685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81167162-af70-497e-83e3-b2116688d909 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.631959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81167162-af70-497e-83e3-b2116688d909 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.632230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81167162-af70-497e-83e3-b2116688d909 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.632919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81167162-af70-497e-83e3-b2116688d909 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:32.633221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81167162-af70-497e-83e3-b2116688d909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.634669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81167162-af70-497e-83e3-b2116688d909 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.644558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 231/451] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:32.650540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad6d4-4897-4da2-a83b-4e077de62c75 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:32.757833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad6d4-4897-4da2-a83b-4e077de62c75 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:32.792676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046223-9a45-44f3-bff3-d308e672df75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:32.793233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046223-9a45-44f3-bff3-d308e672df75 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:32.793582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046223-9a45-44f3-bff3-d308e672df75 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:32.793893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7046223-9a45-44f3-bff3-d308e672df75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:32.803304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:32.863387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046223-9a45-44f3-bff3-d308e672df75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:32.864866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7046223-9a45-44f3-bff3-d308e672df75 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:32.963546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 221/452] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:32.969879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81167162-af70-497e-83e3-b2116688d909 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:33.071228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81167162-af70-497e-83e3-b2116688d909 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:33.103563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf60dbf-6778-4765-ab52-ea2cbe900605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:33.104180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60dbf-6778-4765-ab52-ea2cbe900605 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:33.104461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60dbf-6778-4765-ab52-ea2cbe900605 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:33.104734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf60dbf-6778-4765-ab52-ea2cbe900605 None admin] PATH_INFO: `/v3/projects/83b1863d33eb4870a81458f19dc5d56c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:33.105865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf60dbf-6778-4765-ab52-ea2cbe900605 None admin] RBAC: Authorizing `identity:get_project(project_id=83b1863d33eb4870a81458f19dc5d56c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:33.107306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf60dbf-6778-4765-ab52-ea2cbe900605 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:33.109560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 232/453] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:35:32 2022] GET /identity/v3/projects/83b1863d33eb4870a81458f19dc5d56c => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:33.115089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046223-9a45-44f3-bff3-d308e672df75 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:33.152001 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:33.209397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7046223-9a45-44f3-bff3-d308e672df75 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:33.242532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64a6f9a-bf92-44a3-9226-84687af59b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:33.243145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a6f9a-bf92-44a3-9226-84687af59b65 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:33.243423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a6f9a-bf92-44a3-9226-84687af59b65 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:33.243696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a6f9a-bf92-44a3-9226-84687af59b65 None admin] PATH_INFO: `/v3/groups/224de0f666ec478ea5d1727ffcefcc5e` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:33.244779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a6f9a-bf92-44a3-9226-84687af59b65 None admin] RBAC: Authorizing `identity:get_group(group_id=224de0f666ec478ea5d1727ffcefcc5e)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:33.246241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64a6f9a-bf92-44a3-9226-84687af59b65 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:33.247765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 222/454] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 17 00:35:33 2022] GET /identity/v3/groups/224de0f666ec478ea5d1727ffcefcc5e => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:33.253413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf60dbf-6778-4765-ab52-ea2cbe900605 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:33.293743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:33.350263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf60dbf-6778-4765-ab52-ea2cbe900605 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:33.382429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff4b81b-e8a7-4921-b13e-fcc089dfecd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:33.383021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b81b-e8a7-4921-b13e-fcc089dfecd0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:33.383296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b81b-e8a7-4921-b13e-fcc089dfecd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:33.383563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff4b81b-e8a7-4921-b13e-fcc089dfecd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:33.384280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4b81b-e8a7-4921-b13e-fcc089dfecd0 None admin] RBAC: Adding query filter params (group.id=224de0f666ec478ea5d1727ffcefcc5e, role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=83b1863d33eb4870a81458f19dc5d56c) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:33.384585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4b81b-e8a7-4921-b13e-fcc089dfecd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:33.386034 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff4b81b-e8a7-4921-b13e-fcc089dfecd0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:33.391538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 233/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 17 00:35:33 2022] GET /identity/v3/role_assignments?group.id=224de0f666ec478ea5d1727ffcefcc5e&scope.project.id=83b1863d33eb4870a81458f19dc5d56c&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:35.989733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e04ad-3efb-48fe-a7e5-d7d84badfd24 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:35.990246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e04ad-3efb-48fe-a7e5-d7d84badfd24 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:35.990246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91e04ad-3efb-48fe-a7e5-d7d84badfd24 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:35.991980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 223/456] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:35.997783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a618d9-a637-453a-aed3-b17ae3b7f6b6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:35.998591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a618d9-a637-453a-aed3-b17ae3b7f6b6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:35.999086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a618d9-a637-453a-aed3-b17ae3b7f6b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.027511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-00a618d9-a637-453a-aed3-b17ae3b7f6b6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:36.029090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-00a618d9-a637-453a-aed3-b17ae3b7f6b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:36.133688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 234/457] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:36.287657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e32122-d38a-45fc-b614-6f176af7e958 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.288015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e32122-d38a-45fc-b614-6f176af7e958 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.288200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e32122-d38a-45fc-b614-6f176af7e958 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.289942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 224/458] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:36.295714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a4415-4da9-4d0b-98f3-09fe241009cf None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.296919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a4415-4da9-4d0b-98f3-09fe241009cf None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.297394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6a4415-4da9-4d0b-98f3-09fe241009cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.318455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-5b6a4415-4da9-4d0b-98f3-09fe241009cf None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:36.320031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5b6a4415-4da9-4d0b-98f3-09fe241009cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:36.354393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:36.408058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 235/459] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:36.438196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117b75e-a78c-4c33-ab9d-455c31dd4d2c None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.438493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117b75e-a78c-4c33-ab9d-455c31dd4d2c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.438746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8117b75e-a78c-4c33-ab9d-455c31dd4d2c None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.440080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 225/460] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:36.445453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa59e-7b5a-4dee-bf8f-92d4d059cfe8 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.445734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa59e-7b5a-4dee-bf8f-92d4d059cfe8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.446240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbaa59e-7b5a-4dee-bf8f-92d4d059cfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.474387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-4bbaa59e-7b5a-4dee-bf8f-92d4d059cfe8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:36.475909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4bbaa59e-7b5a-4dee-bf8f-92d4d059cfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:36.511397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117b75e-a78c-4c33-ab9d-455c31dd4d2c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.583974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 236/461] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:36.657235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8117b75e-a78c-4c33-ab9d-455c31dd4d2c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:36.664976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:36.700724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf3120-73e3-4e7e-a4f6-b91402af4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:36.701418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf3120-73e3-4e7e-a4f6-b91402af4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.701710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf3120-73e3-4e7e-a4f6-b91402af4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.701983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf3120-73e3-4e7e-a4f6-b91402af4cf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.713744 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf3120-73e3-4e7e-a4f6-b91402af4cf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:36.715246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf3120-73e3-4e7e-a4f6-b91402af4cf5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-cbaf3120-73e3-4e7e-a4f6-b91402af4cf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:36.736496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:36.737448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:36.738295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:36.738295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:36.738295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:36.738295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 226/462] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:36.743887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa59e-7b5a-4dee-bf8f-92d4d059cfe8 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.748232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf3120-73e3-4e7e-a4f6-b91402af4cf5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.893036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf3120-73e3-4e7e-a4f6-b91402af4cf5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:36.904706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:36.920352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbaa59e-7b5a-4dee-bf8f-92d4d059cfe8 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:36.938576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d93df-99a3-4a3e-ac66-9ae5678568ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:36.939427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d93df-99a3-4a3e-ac66-9ae5678568ef None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.939846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d93df-99a3-4a3e-ac66-9ae5678568ef None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.940258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1d93df-99a3-4a3e-ac66-9ae5678568ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.951455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d93df-99a3-4a3e-ac66-9ae5678568ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:36.953922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1d93df-99a3-4a3e-ac66-9ae5678568ef None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:36.963797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84707e0-f3a6-42d7-a4f2-7c0adb73c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:36.964657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84707e0-f3a6-42d7-a4f2-7c0adb73c096 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:36.965122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84707e0-f3a6-42d7-a4f2-7c0adb73c096 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:36.965660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84707e0-f3a6-42d7-a4f2-7c0adb73c096 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:36.966526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84707e0-f3a6-42d7-a4f2-7c0adb73c096 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:36.966995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84707e0-f3a6-42d7-a4f2-7c0adb73c096 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:36.969043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84707e0-f3a6-42d7-a4f2-7c0adb73c096 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-2d1d93df-99a3-4a3e-ac66-9ae5678568ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:36.970121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:36.971125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:36.971943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:36.971943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:36.971943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:36.973825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 227/463] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:36.974788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d93df-99a3-4a3e-ac66-9ae5678568ef None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.985477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 237/464] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:36.986585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84707e0-f3a6-42d7-a4f2-7c0adb73c096 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:36.993460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.102762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1d93df-99a3-4a3e-ac66-9ae5678568ef None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.128891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84707e0-f3a6-42d7-a4f2-7c0adb73c096 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.142308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc7a87-65de-4e43-8f47-398bff9e09fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.143471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc7a87-65de-4e43-8f47-398bff9e09fe None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.144093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc7a87-65de-4e43-8f47-398bff9e09fe None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.144558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dc7a87-65de-4e43-8f47-398bff9e09fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.156761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc7a87-65de-4e43-8f47-398bff9e09fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.158672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dc7a87-65de-4e43-8f47-398bff9e09fe None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.166543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d7c2ab-5208-4e85-9715-fd27dda31a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.167148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c2ab-5208-4e85-9715-fd27dda31a7f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.167426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c2ab-5208-4e85-9715-fd27dda31a7f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.167702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c2ab-5208-4e85-9715-fd27dda31a7f None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.168835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7c2ab-5208-4e85-9715-fd27dda31a7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:37.169136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7c2ab-5208-4e85-9715-fd27dda31a7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.170792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d7c2ab-5208-4e85-9715-fd27dda31a7f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-d5dc7a87-65de-4e43-8f47-398bff9e09fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:37.176177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:37.177037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:37.177914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:37.177914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:37.177914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:37.178072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 228/465] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:37.178822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc7a87-65de-4e43-8f47-398bff9e09fe None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.184776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 238/466] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:37.186038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a253-852b-4dfc-bdcb-7be515c770e1 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.186323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a253-852b-4dfc-bdcb-7be515c770e1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.186597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c25a253-852b-4dfc-bdcb-7be515c770e1 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.192000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 239/467] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:37.193356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25a253-852b-4dfc-bdcb-7be515c770e1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.210031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.248841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.289871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dc7a87-65de-4e43-8f47-398bff9e09fe None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.309203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c25a253-852b-4dfc-bdcb-7be515c770e1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.324074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30230-84fc-46c6-90da-4656a7cef6d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.324672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30230-84fc-46c6-90da-4656a7cef6d0 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.324951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30230-84fc-46c6-90da-4656a7cef6d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.325224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa30230-84fc-46c6-90da-4656a7cef6d0 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.325896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa30230-84fc-46c6-90da-4656a7cef6d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.327383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa30230-84fc-46c6-90da-4656a7cef6d0 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.349997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 229/468] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:37 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:37.350761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30230-84fc-46c6-90da-4656a7cef6d0 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.354211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddc2f6-1d5d-4ef4-a3bf-39d4c9658a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.354840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc2f6-1d5d-4ef4-a3bf-39d4c9658a52 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.355130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc2f6-1d5d-4ef4-a3bf-39d4c9658a52 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.355385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc2f6-1d5d-4ef4-a3bf-39d4c9658a52 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.356046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddc2f6-1d5d-4ef4-a3bf-39d4c9658a52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:37.356347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddc2f6-1d5d-4ef4-a3bf-39d4c9658a52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.357789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddc2f6-1d5d-4ef4-a3bf-39d4c9658a52 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.371631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 240/469] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:37.372942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6bad-09ef-4a18-b8c9-5de0e09442fd None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.373230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6bad-09ef-4a18-b8c9-5de0e09442fd None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.373602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a6bad-09ef-4a18-b8c9-5de0e09442fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.395333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-df7a6bad-09ef-4a18-b8c9-5de0e09442fd None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:37.396605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-df7a6bad-09ef-4a18-b8c9-5de0e09442fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:37.488796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 241/470] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:37.490090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6bad-09ef-4a18-b8c9-5de0e09442fd None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.494868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.527903 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa30230-84fc-46c6-90da-4656a7cef6d0 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.551049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.576903 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58624e46-8491-42f5-8153-63b44358debf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.578288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624e46-8491-42f5-8153-63b44358debf None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.578569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624e46-8491-42f5-8153-63b44358debf None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.578858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58624e46-8491-42f5-8153-63b44358debf None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.580135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58624e46-8491-42f5-8153-63b44358debf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.580914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58624e46-8491-42f5-8153-63b44358debf None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.608493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 230/471] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:37 2022] POST /identity/v3/users => generated 248 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:37.611189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69152-9746-416e-9b3e-2d58ba91a263 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.611189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69152-9746-416e-9b3e-2d58ba91a263 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.611189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f69152-9746-416e-9b3e-2d58ba91a263 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.611904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 231/472] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:37.618533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b63bc1-9356-4230-be99-6fc37a208471 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.618873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b63bc1-9356-4230-be99-6fc37a208471 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.619072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b63bc1-9356-4230-be99-6fc37a208471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.629784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a6bad-09ef-4a18-b8c9-5de0e09442fd None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.645767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-59b63bc1-9356-4230-be99-6fc37a208471 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:37.647411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-59b63bc1-9356-4230-be99-6fc37a208471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:37.684465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d4bff-24d7-464c-952b-a06a9e34ead4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.685540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d4bff-24d7-464c-952b-a06a9e34ead4 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.686071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d4bff-24d7-464c-952b-a06a9e34ead4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.686545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d4bff-24d7-464c-952b-a06a9e34ead4 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.687954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d4bff-24d7-464c-952b-a06a9e34ead4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.689877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d4bff-24d7-464c-952b-a06a9e34ead4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:37.723138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 242/473] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:37 2022] POST /identity/v3/users => generated 248 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:37.745383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 232/474] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 17 00:35:37.791133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d4bff-24d7-464c-952b-a06a9e34ead4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:37.877310 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:37.932267 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d4bff-24d7-464c-952b-a06a9e34ead4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:37.969638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133657-c459-47a2-b054-1da4641db275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:37.970278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133657-c459-47a2-b054-1da4641db275 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:37.970556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133657-c459-47a2-b054-1da4641db275 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:37.970886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1133657-c459-47a2-b054-1da4641db275 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:37.983029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1133657-c459-47a2-b054-1da4641db275 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:37.985036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1133657-c459-47a2-b054-1da4641db275 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-d1133657-c459-47a2-b054-1da4641db275 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:38.002818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:38.003742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:38.004581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:38.004581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:38.004581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:38.005683 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 243/475] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:38.011382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b63bc1-9356-4230-be99-6fc37a208471 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:38.092296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133657-c459-47a2-b054-1da4641db275 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:38.141347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b63bc1-9356-4230-be99-6fc37a208471 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:38.145031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:38.190864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e2da-0d6b-4da8-bdef-c7ac161efa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:38.192072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e2da-0d6b-4da8-bdef-c7ac161efa4a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:38.192967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e2da-0d6b-4da8-bdef-c7ac161efa4a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:38.193473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd02e2da-0d6b-4da8-bdef-c7ac161efa4a None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:38.194824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02e2da-0d6b-4da8-bdef-c7ac161efa4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:38.195355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02e2da-0d6b-4da8-bdef-c7ac161efa4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:38.197587 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd02e2da-0d6b-4da8-bdef-c7ac161efa4a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:38.213824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 233/476] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:38.214394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1133657-c459-47a2-b054-1da4641db275 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:38.222706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e2da-0d6b-4da8-bdef-c7ac161efa4a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:38.235265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:38.270387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:38.271471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:38.273038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:38.274108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:38.275068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:38.276797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:38.293789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.sql.core [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 00:35:38.293789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 17 00:35:38.293789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [parameters: {'id': '9e08b34a02824227b318bd00db0b5edf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 17 00:35:38.293789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87920) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application result.read() Sep 17 00:35:38.320852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return ref.to_dict() Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:35:38.321810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application yield resource Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise self.value Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application session.commit() Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 00:35:38.322717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.session.flush() Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application compat.raise_( Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 00:35:38.323579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:35:38.324442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application result.read() Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:35:38.325237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [parameters: {'id': '9e08b34a02824227b318bd00db0b5edf', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:38.326031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 17 00:35:38.326830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:38.329071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 244/477] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 17 00:35:38 2022] POST /identity/v3/roles => generated 144 bytes in 237 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:38.336714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:38.451687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd02e2da-0d6b-4da8-bdef-c7ac161efa4a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:38.481306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70268b15-2dcc-4312-9caa-79ae2a0dbb4a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:38.525163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996bda-bd6a-4d72-b475-16aa2c085753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:38.525801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996bda-bd6a-4d72-b475-16aa2c085753 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:38.526081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996bda-bd6a-4d72-b475-16aa2c085753 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:38.526351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01996bda-bd6a-4d72-b475-16aa2c085753 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:38.527012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01996bda-bd6a-4d72-b475-16aa2c085753 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:38.528448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01996bda-bd6a-4d72-b475-16aa2c085753 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:38.535260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436a8bb-eedc-4e64-97b7-988f2b95b2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:38.535927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436a8bb-eedc-4e64-97b7-988f2b95b2bf None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:38.536205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436a8bb-eedc-4e64-97b7-988f2b95b2bf None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:38.536476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436a8bb-eedc-4e64-97b7-988f2b95b2bf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:38.560498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436a8bb-eedc-4e64-97b7-988f2b95b2bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-4436a8bb-eedc-4e64-97b7-988f2b95b2bf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:38.566992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:38.568001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 17 00:35:38.568781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:38.575061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 234/478] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:38 2022] POST /identity/v3/users => generated 249 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:35:38.576329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 245/479] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:35:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:38.582998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996bda-bd6a-4d72-b475-16aa2c085753 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:38.611962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:38.700026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01996bda-bd6a-4d72-b475-16aa2c085753 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:38.737702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f84807-2858-4c94-88c7-1dbbc65505c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:38.738243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84807-2858-4c94-88c7-1dbbc65505c5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:38.738527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84807-2858-4c94-88c7-1dbbc65505c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:38.738807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f84807-2858-4c94-88c7-1dbbc65505c5 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:38.739488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f84807-2858-4c94-88c7-1dbbc65505c5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:38.739793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f84807-2858-4c94-88c7-1dbbc65505c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:38.741176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f84807-2858-4c94-88c7-1dbbc65505c5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:38.750249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 235/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:40.037333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a882af-be09-436a-a17f-8662670c6b1b None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.037865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a882af-be09-436a-a17f-8662670c6b1b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.037972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a882af-be09-436a-a17f-8662670c6b1b None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.039510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 246/481] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:40.044754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36206-9090-4c63-a6af-c96277c72727 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.045157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36206-9090-4c63-a6af-c96277c72727 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.045320 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd36206-9090-4c63-a6af-c96277c72727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.074352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3dd36206-9090-4c63-a6af-c96277c72727 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:40.075556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3dd36206-9090-4c63-a6af-c96277c72727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:40.167840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 236/482] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:40.417857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92f2ca-7872-4b9f-854a-4cc53cc0d9e9 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.417857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92f2ca-7872-4b9f-854a-4cc53cc0d9e9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.417857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc92f2ca-7872-4b9f-854a-4cc53cc0d9e9 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.419447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 247/483] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:40.424513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f207e40-833a-45e8-b324-9c8970148831 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.425032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f207e40-833a-45e8-b324-9c8970148831 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.425540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f207e40-833a-45e8-b324-9c8970148831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.455240 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7f207e40-833a-45e8-b324-9c8970148831 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:40.456752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7f207e40-833a-45e8-b324-9c8970148831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:40.467485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:40.536162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 237/484] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:40.552635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92f2ca-7872-4b9f-854a-4cc53cc0d9e9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:40.589008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:40.675443 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc92f2ca-7872-4b9f-854a-4cc53cc0d9e9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:40.721122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704479f8-0592-4c17-ac78-c6319cd30730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:40.722151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704479f8-0592-4c17-ac78-c6319cd30730 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.722644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704479f8-0592-4c17-ac78-c6319cd30730 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.723122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704479f8-0592-4c17-ac78-c6319cd30730 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.739002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704479f8-0592-4c17-ac78-c6319cd30730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-704479f8-0592-4c17-ac78-c6319cd30730 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:40.744121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:40.744954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:40.745760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:40.747959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 248/485] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:40.758514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f207e40-833a-45e8-b324-9c8970148831 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:40.814926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfcc39-8845-4086-bf79-9006ee2f878f None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.815584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfcc39-8845-4086-bf79-9006ee2f878f None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.816054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddfcc39-8845-4086-bf79-9006ee2f878f None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.818790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 249/486] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:40.822679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc6c2c-7106-416b-84ae-a61e83d19785 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.823276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc6c2c-7106-416b-84ae-a61e83d19785 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.823761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc6c2c-7106-416b-84ae-a61e83d19785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.860455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f5dc6c2c-7106-416b-84ae-a61e83d19785 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:40.861691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f5dc6c2c-7106-416b-84ae-a61e83d19785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:40.896745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f207e40-833a-45e8-b324-9c8970148831 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:40.933635 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b84f9-4afa-4118-a518-e69d7b808d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:40.934565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b84f9-4afa-4118-a518-e69d7b808d88 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:40.935034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b84f9-4afa-4118-a518-e69d7b808d88 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:40.935497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b84f9-4afa-4118-a518-e69d7b808d88 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:40.935787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 250/487] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:40.936703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b84f9-4afa-4118-a518-e69d7b808d88 None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:40.937044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc6c2c-7106-416b-84ae-a61e83d19785 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:40.937157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b84f9-4afa-4118-a518-e69d7b808d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:40.938670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b84f9-4afa-4118-a518-e69d7b808d88 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:40.959815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 238/488] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:40.965933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b84f9-4afa-4118-a518-e69d7b808d88 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:40.971483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:40.984158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.119564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc6c2c-7106-416b-84ae-a61e83d19785 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.135086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b84f9-4afa-4118-a518-e69d7b808d88 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.188865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8742971-55ab-43d1-936d-193a91578c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.189435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8742971-55ab-43d1-936d-193a91578c05 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.189723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8742971-55ab-43d1-936d-193a91578c05 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.190006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8742971-55ab-43d1-936d-193a91578c05 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.193926 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5204-0570-41fb-9f1f-a231bdabd98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.194556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5204-0570-41fb-9f1f-a231bdabd98c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.194836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5204-0570-41fb-9f1f-a231bdabd98c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.195110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb5204-0570-41fb-9f1f-a231bdabd98c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.207538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5204-0570-41fb-9f1f-a231bdabd98c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.209352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bb5204-0570-41fb-9f1f-a231bdabd98c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.213000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8742971-55ab-43d1-936d-193a91578c05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-e8742971-55ab-43d1-936d-193a91578c05 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:41.220131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.221022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:41.221866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:41.225550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 251/489] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:41.231636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8742971-55ab-43d1-936d-193a91578c05 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-29bb5204-0570-41fb-9f1f-a231bdabd98c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:41.235511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.236379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:41.237245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:41.237245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.237245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:41.239856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 239/490] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:41.248619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5204-0570-41fb-9f1f-a231bdabd98c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.321913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.332896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.350996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8742971-55ab-43d1-936d-193a91578c05 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.389295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb5204-0570-41fb-9f1f-a231bdabd98c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.407932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771871d-3f74-4ae5-9d64-4d5b35e8e964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.409335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771871d-3f74-4ae5-9d64-4d5b35e8e964 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.409878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771871d-3f74-4ae5-9d64-4d5b35e8e964 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.410556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771871d-3f74-4ae5-9d64-4d5b35e8e964 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.411496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771871d-3f74-4ae5-9d64-4d5b35e8e964 None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.412019 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771871d-3f74-4ae5-9d64-4d5b35e8e964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.420171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771871d-3f74-4ae5-9d64-4d5b35e8e964 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.431467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf5f56-d5ce-45d4-bdae-4ea2305e2eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.432638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf5f56-d5ce-45d4-bdae-4ea2305e2eb5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.432921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf5f56-d5ce-45d4-bdae-4ea2305e2eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.433196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf5f56-d5ce-45d4-bdae-4ea2305e2eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.434156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf5f56-d5ce-45d4-bdae-4ea2305e2eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.434472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf5f56-d5ce-45d4-bdae-4ea2305e2eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.435847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf5f56-d5ce-45d4-bdae-4ea2305e2eb5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.436387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 252/491] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:41.437435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771871d-3f74-4ae5-9d64-4d5b35e8e964 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.461746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 240/492] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:41.462738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf5f56-d5ce-45d4-bdae-4ea2305e2eb5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.548344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771871d-3f74-4ae5-9d64-4d5b35e8e964 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.569098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf5f56-d5ce-45d4-bdae-4ea2305e2eb5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.581081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f3aee-c22f-4c01-be02-4ecef63e7b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.581748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f3aee-c22f-4c01-be02-4ecef63e7b5e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.582204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f3aee-c22f-4c01-be02-4ecef63e7b5e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.582488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714f3aee-c22f-4c01-be02-4ecef63e7b5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.585452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.592825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714f3aee-c22f-4c01-be02-4ecef63e7b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-714f3aee-c22f-4c01-be02-4ecef63e7b5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:41.598600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.599660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 253/493] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:41.600545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f3aee-c22f-4c01-be02-4ecef63e7b5e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.605207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a6122-057d-4299-a4e7-a34fea239200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.605876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a6122-057d-4299-a4e7-a34fea239200 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.606157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a6122-057d-4299-a4e7-a34fea239200 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.606430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a6122-057d-4299-a4e7-a34fea239200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.612453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.616985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a6122-057d-4299-a4e7-a34fea239200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.618755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a6122-057d-4299-a4e7-a34fea239200 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-0b1a6122-057d-4299-a4e7-a34fea239200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:41.633222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.634133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:41.635016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:41.635016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:41.635016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:41.635016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 241/494] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:41.635501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fb4b7-3fe4-47d2-9fbd-4d40617016e5 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.635805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fb4b7-3fe4-47d2-9fbd-4d40617016e5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.635983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462fb4b7-3fe4-47d2-9fbd-4d40617016e5 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.641810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 242/495] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:41.641810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061d609-bc31-4e31-9612-4d82b48474d2 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.641810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061d609-bc31-4e31-9612-4d82b48474d2 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.641810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5061d609-bc31-4e31-9612-4d82b48474d2 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.641810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 243/496] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:41.642778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061d609-bc31-4e31-9612-4d82b48474d2 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.700891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714f3aee-c22f-4c01-be02-4ecef63e7b5e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.735684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d5171-ff20-4cab-8d65-faf481db91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.736675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5171-ff20-4cab-8d65-faf481db91e0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.737170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5171-ff20-4cab-8d65-faf481db91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.737697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667d5171-ff20-4cab-8d65-faf481db91e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.742453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5061d609-bc31-4e31-9612-4d82b48474d2 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.747370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d5171-ff20-4cab-8d65-faf481db91e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.748842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667d5171-ff20-4cab-8d65-faf481db91e0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-667d5171-ff20-4cab-8d65-faf481db91e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:41.763892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:41.764835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:41.765765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 254/497] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:41.766324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d5171-ff20-4cab-8d65-faf481db91e0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.778520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f021bb2-b418-405f-b7d1-119acf9e7ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.779129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021bb2-b418-405f-b7d1-119acf9e7ccd None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.779409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021bb2-b418-405f-b7d1-119acf9e7ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.779684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f021bb2-b418-405f-b7d1-119acf9e7ccd None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.780657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021bb2-b418-405f-b7d1-119acf9e7ccd None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.780972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021bb2-b418-405f-b7d1-119acf9e7ccd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.782434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f021bb2-b418-405f-b7d1-119acf9e7ccd None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.790455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 244/498] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:41.791621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5584a9-af65-4aec-8c9c-71338146bd37 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.791909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5584a9-af65-4aec-8c9c-71338146bd37 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.792192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5584a9-af65-4aec-8c9c-71338146bd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.809898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-6a5584a9-af65-4aec-8c9c-71338146bd37 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:41.811075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-6a5584a9-af65-4aec-8c9c-71338146bd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:41.831543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.836862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:41.865816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667d5171-ff20-4cab-8d65-faf481db91e0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:41.880219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 245/499] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:41.881453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74987625-a5ea-49ab-8162-154cc27ada9c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.881742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74987625-a5ea-49ab-8162-154cc27ada9c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.882024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74987625-a5ea-49ab-8162-154cc27ada9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.898708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-74987625-a5ea-49ab-8162-154cc27ada9c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:41.899886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-74987625-a5ea-49ab-8162-154cc27ada9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:41.902259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d735841-1904-4fd4-831b-3f62e30e4670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:41.903081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735841-1904-4fd4-831b-3f62e30e4670 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:41.903503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735841-1904-4fd4-831b-3f62e30e4670 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:41.903955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d735841-1904-4fd4-831b-3f62e30e4670 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:41.904789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d735841-1904-4fd4-831b-3f62e30e4670 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:41.905250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d735841-1904-4fd4-831b-3f62e30e4670 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:41.907353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d735841-1904-4fd4-831b-3f62e30e4670 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:41.920841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 255/500] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:41.922461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d735841-1904-4fd4-831b-3f62e30e4670 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:41.971047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 246/501] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:41.972114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74987625-a5ea-49ab-8162-154cc27ada9c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.041639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d735841-1904-4fd4-831b-3f62e30e4670 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.075258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.086109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34369952-7426-4169-ae80-502b8810a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.086846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369952-7426-4169-ae80-502b8810a720 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.087229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369952-7426-4169-ae80-502b8810a720 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.087658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34369952-7426-4169-ae80-502b8810a720 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.089115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34369952-7426-4169-ae80-502b8810a720 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:42.089443 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34369952-7426-4169-ae80-502b8810a720 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.091224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.092192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34369952-7426-4169-ae80-502b8810a720 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.102796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74987625-a5ea-49ab-8162-154cc27ada9c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.137277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 256/502] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:42.138907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34369952-7426-4169-ae80-502b8810a720 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.145856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6976a-8b2a-40ac-9005-f4daaaaec0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.146505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6976a-8b2a-40ac-9005-f4daaaaec0e1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.146785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6976a-8b2a-40ac-9005-f4daaaaec0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.147057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6976a-8b2a-40ac-9005-f4daaaaec0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.161390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6976a-8b2a-40ac-9005-f4daaaaec0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.163679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6976a-8b2a-40ac-9005-f4daaaaec0e1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-1ee6976a-8b2a-40ac-9005-f4daaaaec0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:42.179361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.180262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:42.181187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:42.181187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:42.181187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:42.181187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 247/503] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.181872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6976a-8b2a-40ac-9005-f4daaaaec0e1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.249142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34369952-7426-4169-ae80-502b8810a720 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.283323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9befed7-7974-447c-8734-2ebe2d576f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.283949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9befed7-7974-447c-8734-2ebe2d576f92 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.284373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9befed7-7974-447c-8734-2ebe2d576f92 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.284655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9befed7-7974-447c-8734-2ebe2d576f92 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.287474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6976a-8b2a-40ac-9005-f4daaaaec0e1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.291852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9befed7-7974-447c-8734-2ebe2d576f92 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.293239 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9befed7-7974-447c-8734-2ebe2d576f92 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-c9befed7-7974-447c-8734-2ebe2d576f92 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:42.305752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.306639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:42.307514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 257/504] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.308076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9befed7-7974-447c-8734-2ebe2d576f92 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.324221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73991fc3-a9eb-4b73-9687-bbf46d760951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.324836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991fc3-a9eb-4b73-9687-bbf46d760951 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.325111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991fc3-a9eb-4b73-9687-bbf46d760951 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.325384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73991fc3-a9eb-4b73-9687-bbf46d760951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.335962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73991fc3-a9eb-4b73-9687-bbf46d760951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.337396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73991fc3-a9eb-4b73-9687-bbf46d760951 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.339344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-73991fc3-a9eb-4b73-9687-bbf46d760951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:42.352933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.354085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:42.355134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:42.355134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:42.355134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:42.355134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 248/505] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.355134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73991fc3-a9eb-4b73-9687-bbf46d760951 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.358531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.413844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9befed7-7974-447c-8734-2ebe2d576f92 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.446735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01effb-98c6-41b6-b759-5a0b0c5bd5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.447348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01effb-98c6-41b6-b759-5a0b0c5bd5f3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.447625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01effb-98c6-41b6-b759-5a0b0c5bd5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.447898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01effb-98c6-41b6-b759-5a0b0c5bd5f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.457050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73991fc3-a9eb-4b73-9687-bbf46d760951 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.490733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2087e31-3e6e-4213-889c-552324341ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.491332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2087e31-3e6e-4213-889c-552324341ddc None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.491614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2087e31-3e6e-4213-889c-552324341ddc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.491885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2087e31-3e6e-4213-889c-552324341ddc None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.492527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2087e31-3e6e-4213-889c-552324341ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:42.492828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2087e31-3e6e-4213-889c-552324341ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.494224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2087e31-3e6e-4213-889c-552324341ddc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.505585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 249/506] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:42.506522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2087e31-3e6e-4213-889c-552324341ddc None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.516478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01effb-98c6-41b6-b759-5a0b0c5bd5f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.517994 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01effb-98c6-41b6-b759-5a0b0c5bd5f3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.559694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.561165 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.604171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2087e31-3e6e-4213-889c-552324341ddc None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.615735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 258/507] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:42.616689 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01effb-98c6-41b6-b759-5a0b0c5bd5f3 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.637869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3102e2-e889-4a3f-a45c-002b9cd7c99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.638491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3102e2-e889-4a3f-a45c-002b9cd7c99c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.638780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3102e2-e889-4a3f-a45c-002b9cd7c99c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.639055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3102e2-e889-4a3f-a45c-002b9cd7c99c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.649571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3102e2-e889-4a3f-a45c-002b9cd7c99c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-5f3102e2-e889-4a3f-a45c-002b9cd7c99c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:42.654309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.655182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:42.656496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 250/508] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.657151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3102e2-e889-4a3f-a45c-002b9cd7c99c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.715966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01effb-98c6-41b6-b759-5a0b0c5bd5f3 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.749762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92273b-b819-4aef-8344-9f24d5119b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.750359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92273b-b819-4aef-8344-9f24d5119b91 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.750638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92273b-b819-4aef-8344-9f24d5119b91 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.750911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92273b-b819-4aef-8344-9f24d5119b91 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.751635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92273b-b819-4aef-8344-9f24d5119b91 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:42.751945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92273b-b819-4aef-8344-9f24d5119b91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.753370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92273b-b819-4aef-8344-9f24d5119b91 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.754610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3102e2-e889-4a3f-a45c-002b9cd7c99c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.768075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.770044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 259/509] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:42.770780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92273b-b819-4aef-8344-9f24d5119b91 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.775456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.789623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984baea-32f4-420e-a95b-3e4ac0016358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.790228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984baea-32f4-420e-a95b-3e4ac0016358 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.790506 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984baea-32f4-420e-a95b-3e4ac0016358 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.790782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8984baea-32f4-420e-a95b-3e4ac0016358 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.791425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984baea-32f4-420e-a95b-3e4ac0016358 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:42.791725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984baea-32f4-420e-a95b-3e4ac0016358 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.793450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8984baea-32f4-420e-a95b-3e4ac0016358 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.805226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 251/510] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:42.806074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984baea-32f4-420e-a95b-3e4ac0016358 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.874931 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92273b-b819-4aef-8344-9f24d5119b91 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.904313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8984baea-32f4-420e-a95b-3e4ac0016358 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:42.906947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb1d5a-50c3-4e52-be1c-175f8510228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.907571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb1d5a-50c3-4e52-be1c-175f8510228c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.907843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb1d5a-50c3-4e52-be1c-175f8510228c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.908114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb1d5a-50c3-4e52-be1c-175f8510228c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.914832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb1d5a-50c3-4e52-be1c-175f8510228c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.916278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb1d5a-50c3-4e52-be1c-175f8510228c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-53cb1d5a-50c3-4e52-be1c-175f8510228c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:42.927592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.928498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:42.929372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 260/511] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.929946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb1d5a-50c3-4e52-be1c-175f8510228c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.940776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9df37-c65e-4cee-a4ad-ce851ac6d1b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:42.941422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9df37-c65e-4cee-a4ad-ce851ac6d1b4 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:42.941709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9df37-c65e-4cee-a4ad-ce851ac6d1b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:42.941986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad9df37-c65e-4cee-a4ad-ce851ac6d1b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:42.952487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9df37-c65e-4cee-a4ad-ce851ac6d1b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:42.953968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad9df37-c65e-4cee-a4ad-ce851ac6d1b4 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-fad9df37-c65e-4cee-a4ad-ce851ac6d1b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:42.968294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:42.969167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:42.970200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:42.970200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:42.970200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:42.970200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 252/512] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:42.970200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9df37-c65e-4cee-a4ad-ce851ac6d1b4 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:42.992800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:42.998079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.031091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb1d5a-50c3-4e52-be1c-175f8510228c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.064601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005f477-8534-415b-ab3c-d0e6460ab9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.065199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005f477-8534-415b-ab3c-d0e6460ab9c7 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.065510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005f477-8534-415b-ab3c-d0e6460ab9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.065792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005f477-8534-415b-ab3c-d0e6460ab9c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.066452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005f477-8534-415b-ab3c-d0e6460ab9c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:43.066754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005f477-8534-415b-ab3c-d0e6460ab9c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.068101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c005f477-8534-415b-ab3c-d0e6460ab9c7 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.069275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad9df37-c65e-4cee-a4ad-ce851ac6d1b4 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.075859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 261/513] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:43.076620 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005f477-8534-415b-ab3c-d0e6460ab9c7 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.107481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18f1db-db52-425d-ac42-607aa08ed2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.108076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18f1db-db52-425d-ac42-607aa08ed2d1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.108378 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18f1db-db52-425d-ac42-607aa08ed2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.108661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b18f1db-db52-425d-ac42-607aa08ed2d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.178782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18f1db-db52-425d-ac42-607aa08ed2d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.180176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b18f1db-db52-425d-ac42-607aa08ed2d1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.180971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005f477-8534-415b-ab3c-d0e6460ab9c7 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.206283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.207078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.216280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fe2c8-5182-4ea5-b8ee-96c5e1d8fde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.216895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fe2c8-5182-4ea5-b8ee-96c5e1d8fde5 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.217178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fe2c8-5182-4ea5-b8ee-96c5e1d8fde5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.217494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1fe2c8-5182-4ea5-b8ee-96c5e1d8fde5 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.218686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fe2c8-5182-4ea5-b8ee-96c5e1d8fde5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.220116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1fe2c8-5182-4ea5-b8ee-96c5e1d8fde5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.239525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 262/514] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:35:43 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:35:43.240317 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fe2c8-5182-4ea5-b8ee-96c5e1d8fde5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.302377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 253/515] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:43.303389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18f1db-db52-425d-ac42-607aa08ed2d1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.358852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1fe2c8-5182-4ea5-b8ee-96c5e1d8fde5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.396297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565adacb-a2be-4d49-9a37-7b417204281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.397524 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565adacb-a2be-4d49-9a37-7b417204281e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.397864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565adacb-a2be-4d49-9a37-7b417204281e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.398205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565adacb-a2be-4d49-9a37-7b417204281e None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.399028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565adacb-a2be-4d49-9a37-7b417204281e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:43.399428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565adacb-a2be-4d49-9a37-7b417204281e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.401522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565adacb-a2be-4d49-9a37-7b417204281e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.412759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b18f1db-db52-425d-ac42-607aa08ed2d1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.426072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 263/516] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:43.426894 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565adacb-a2be-4d49-9a37-7b417204281e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.447627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.458743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000085c-90a1-40a5-99ce-019c5916378a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.459361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000085c-90a1-40a5-99ce-019c5916378a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.459746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000085c-90a1-40a5-99ce-019c5916378a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.459919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f000085c-90a1-40a5-99ce-019c5916378a None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.460541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000085c-90a1-40a5-99ce-019c5916378a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:43.460839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000085c-90a1-40a5-99ce-019c5916378a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.463576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f000085c-90a1-40a5-99ce-019c5916378a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.476645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 254/517] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:43.477594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000085c-90a1-40a5-99ce-019c5916378a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.482765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.541999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565adacb-a2be-4d49-9a37-7b417204281e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.578674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93110c-8cfa-44aa-84e8-f194eedfd178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.579302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93110c-8cfa-44aa-84e8-f194eedfd178 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.579577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93110c-8cfa-44aa-84e8-f194eedfd178 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.579866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93110c-8cfa-44aa-84e8-f194eedfd178 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.582000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f000085c-90a1-40a5-99ce-019c5916378a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.590495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93110c-8cfa-44aa-84e8-f194eedfd178 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.591928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93110c-8cfa-44aa-84e8-f194eedfd178 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-5a93110c-8cfa-44aa-84e8-f194eedfd178 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:43.606951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:43.607859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:43.608778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:43.608778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.608778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:43.608778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 264/518] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:43.608996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93110c-8cfa-44aa-84e8-f194eedfd178 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.622738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e2383-c5a9-430c-93a2-d4d1349d514a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.623370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e2383-c5a9-430c-93a2-d4d1349d514a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.623645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e2383-c5a9-430c-93a2-d4d1349d514a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.623915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185e2383-c5a9-430c-93a2-d4d1349d514a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.634901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e2383-c5a9-430c-93a2-d4d1349d514a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.636362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185e2383-c5a9-430c-93a2-d4d1349d514a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-185e2383-c5a9-430c-93a2-d4d1349d514a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:43.650192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:43.651272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:43.652104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:43.652104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:43.652104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:43.653736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 255/519] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:43.655129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e2383-c5a9-430c-93a2-d4d1349d514a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.698007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.707578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.717302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93110c-8cfa-44aa-84e8-f194eedfd178 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.752407 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789d444-0050-491c-a6da-a96fffdca85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.753011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789d444-0050-491c-a6da-a96fffdca85b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.753296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789d444-0050-491c-a6da-a96fffdca85b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.753581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789d444-0050-491c-a6da-a96fffdca85b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.763377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185e2383-c5a9-430c-93a2-d4d1349d514a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.799989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624661a4-2693-466e-9990-4e624bb71f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.800713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624661a4-2693-466e-9990-4e624bb71f71 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.800995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624661a4-2693-466e-9990-4e624bb71f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.801264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624661a4-2693-466e-9990-4e624bb71f71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.807988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624661a4-2693-466e-9990-4e624bb71f71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.809466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624661a4-2693-466e-9990-4e624bb71f71 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-624661a4-2693-466e-9990-4e624bb71f71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:43.822836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:43.823724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:43.824569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:43.824569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:43.824569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:43.824569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:43.824569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:43.824569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:43.824569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:43.824569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:43.824569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 256/520] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:43.825607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624661a4-2693-466e-9990-4e624bb71f71 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.833583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789d444-0050-491c-a6da-a96fffdca85b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.835102 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5789d444-0050-491c-a6da-a96fffdca85b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.921492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.925724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624661a4-2693-466e-9990-4e624bb71f71 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:43.931608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:43.942800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 265/521] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:43.943619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789d444-0050-491c-a6da-a96fffdca85b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:43.966207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843d61-d15e-4492-b859-c8d32b8facc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:43.966746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843d61-d15e-4492-b859-c8d32b8facc8 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:43.967031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843d61-d15e-4492-b859-c8d32b8facc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:43.967313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29843d61-d15e-4492-b859-c8d32b8facc8 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:43.968599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29843d61-d15e-4492-b859-c8d32b8facc8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:43.968910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29843d61-d15e-4492-b859-c8d32b8facc8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:43.970323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29843d61-d15e-4492-b859-c8d32b8facc8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:43.987552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 257/522] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:43.987552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843d61-d15e-4492-b859-c8d32b8facc8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.053413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789d444-0050-491c-a6da-a96fffdca85b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.086270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29843d61-d15e-4492-b859-c8d32b8facc8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.090936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee20c2-c4be-4559-b769-77c7c7ef8abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.091537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee20c2-c4be-4559-b769-77c7c7ef8abe None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.091815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee20c2-c4be-4559-b769-77c7c7ef8abe None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.092117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee20c2-c4be-4559-b769-77c7c7ef8abe None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.092718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee20c2-c4be-4559-b769-77c7c7ef8abe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:44.093620 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee20c2-c4be-4559-b769-77c7c7ef8abe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.094987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee20c2-c4be-4559-b769-77c7c7ef8abe None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.107118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 266/523] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:44.108364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee20c2-c4be-4559-b769-77c7c7ef8abe None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.125392 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da5907-f42d-4bf8-ab94-1b36e55861d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.126025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5907-f42d-4bf8-ab94-1b36e55861d5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.126306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5907-f42d-4bf8-ab94-1b36e55861d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.126575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da5907-f42d-4bf8-ab94-1b36e55861d5 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.127265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da5907-f42d-4bf8-ab94-1b36e55861d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:44.127565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da5907-f42d-4bf8-ab94-1b36e55861d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.128987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34da5907-f42d-4bf8-ab94-1b36e55861d5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.150729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 258/524] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:44.150729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da5907-f42d-4bf8-ab94-1b36e55861d5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.172151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.173101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.223507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee20c2-c4be-4559-b769-77c7c7ef8abe None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.257687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da5907-f42d-4bf8-ab94-1b36e55861d5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.261000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb8c6-86be-4776-a998-49c626b9389e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.261652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb8c6-86be-4776-a998-49c626b9389e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.261932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb8c6-86be-4776-a998-49c626b9389e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.262204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aeb8c6-86be-4776-a998-49c626b9389e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.272470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aeb8c6-86be-4776-a998-49c626b9389e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.273935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aeb8c6-86be-4776-a998-49c626b9389e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-64aeb8c6-86be-4776-a998-49c626b9389e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:44.288011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:44.288898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:44.290077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:44.290077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:44.290077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:44.290077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 267/525] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:44.290077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb8c6-86be-4776-a998-49c626b9389e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.304307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5505a-4b15-4cdf-86e8-c697263e3839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.305508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5505a-4b15-4cdf-86e8-c697263e3839 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.306223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5505a-4b15-4cdf-86e8-c697263e3839 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.306692 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5505a-4b15-4cdf-86e8-c697263e3839 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.315179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5505a-4b15-4cdf-86e8-c697263e3839 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.316623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5505a-4b15-4cdf-86e8-c697263e3839 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-2cd5505a-4b15-4cdf-86e8-c697263e3839 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:44.329728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:44.330588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:44.331438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 259/526] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:44.331994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5505a-4b15-4cdf-86e8-c697263e3839 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.398563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aeb8c6-86be-4776-a998-49c626b9389e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.401635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.418852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.440907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa5484-4cb9-480a-8f2a-b3a19401bda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.442015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa5484-4cb9-480a-8f2a-b3a19401bda1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.442504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa5484-4cb9-480a-8f2a-b3a19401bda1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.443000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caaa5484-4cb9-480a-8f2a-b3a19401bda1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.443621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5505a-4b15-4cdf-86e8-c697263e3839 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.450628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa5484-4cb9-480a-8f2a-b3a19401bda1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.452117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caaa5484-4cb9-480a-8f2a-b3a19401bda1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-caaa5484-4cb9-480a-8f2a-b3a19401bda1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:44.464919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:44.465839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:44.466790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:44.466790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:44.466790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:44.466790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:44.466790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:44.466790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:44.466790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.466790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:44.466790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 268/527] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:44.467249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa5484-4cb9-480a-8f2a-b3a19401bda1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.497643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de889b1f-8404-4ac4-a8a6-648a37d48e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.498158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de889b1f-8404-4ac4-a8a6-648a37d48e00 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.498467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de889b1f-8404-4ac4-a8a6-648a37d48e00 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.498712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de889b1f-8404-4ac4-a8a6-648a37d48e00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.499497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de889b1f-8404-4ac4-a8a6-648a37d48e00 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=2dbd23de9096446091fb9b7f79f047fc) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:44.499966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de889b1f-8404-4ac4-a8a6-648a37d48e00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.501578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de889b1f-8404-4ac4-a8a6-648a37d48e00 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.513438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 260/528] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/role_assignments?user.id=2dbd23de9096446091fb9b7f79f047fc&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:44.513438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de889b1f-8404-4ac4-a8a6-648a37d48e00 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.591439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caaa5484-4cb9-480a-8f2a-b3a19401bda1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.635988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de889b1f-8404-4ac4-a8a6-648a37d48e00 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.640315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a916a0-00ba-4039-b8ee-2456d17a269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.641069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a916a0-00ba-4039-b8ee-2456d17a269e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.641474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a916a0-00ba-4039-b8ee-2456d17a269e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.641847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a916a0-00ba-4039-b8ee-2456d17a269e None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.642603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a916a0-00ba-4039-b8ee-2456d17a269e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:44.643002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a916a0-00ba-4039-b8ee-2456d17a269e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.645036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a916a0-00ba-4039-b8ee-2456d17a269e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.662398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 269/529] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:44.663509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a916a0-00ba-4039-b8ee-2456d17a269e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.679101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04cb88-2356-48ac-b48c-de8a08cb94ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.679791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04cb88-2356-48ac-b48c-de8a08cb94ff None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.680074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04cb88-2356-48ac-b48c-de8a08cb94ff None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.680348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04cb88-2356-48ac-b48c-de8a08cb94ff None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.681091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04cb88-2356-48ac-b48c-de8a08cb94ff None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:44.681520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04cb88-2356-48ac-b48c-de8a08cb94ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.683240 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04cb88-2356-48ac-b48c-de8a08cb94ff None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.696478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.725329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.735472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 261/530] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:44.736329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04cb88-2356-48ac-b48c-de8a08cb94ff None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.799237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a916a0-00ba-4039-b8ee-2456d17a269e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.839731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04cb88-2356-48ac-b48c-de8a08cb94ff None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:44.845573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa746637-a082-488c-a380-184c5a1657f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.846396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa746637-a082-488c-a380-184c5a1657f8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.846844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa746637-a082-488c-a380-184c5a1657f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.847275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa746637-a082-488c-a380-184c5a1657f8 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.848124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa746637-a082-488c-a380-184c5a1657f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:44.848581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa746637-a082-488c-a380-184c5a1657f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.850308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa746637-a082-488c-a380-184c5a1657f8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.875799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 270/531] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:44.877068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa746637-a082-488c-a380-184c5a1657f8 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.886187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f632d0f-bbf0-46d7-a298-e8a264235fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:44.887166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632d0f-bbf0-46d7-a298-e8a264235fc3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:44.887642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632d0f-bbf0-46d7-a298-e8a264235fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:44.888109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f632d0f-bbf0-46d7-a298-e8a264235fc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:44.899062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f632d0f-bbf0-46d7-a298-e8a264235fc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:44.901460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f632d0f-bbf0-46d7-a298-e8a264235fc3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-0f632d0f-bbf0-46d7-a298-e8a264235fc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:44.918780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:44.919624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:44.920428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:44.920428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:44.920428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:44.920428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:44.920428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:44.920428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:44.920428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:44.920428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:44.927303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 262/532] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:44.927303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f632d0f-bbf0-46d7-a298-e8a264235fc3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:44.976164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.990590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:44.994480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa746637-a082-488c-a380-184c5a1657f8 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.035298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f632d0f-bbf0-46d7-a298-e8a264235fc3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.035565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977370c5-ed43-40ba-92ab-57d0780100fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.036190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977370c5-ed43-40ba-92ab-57d0780100fe None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.036470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977370c5-ed43-40ba-92ab-57d0780100fe None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.036745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977370c5-ed43-40ba-92ab-57d0780100fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.071303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6fd50-998e-49d4-b673-38f2d4d814d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.072128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6fd50-998e-49d4-b673-38f2d4d814d4 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.072550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6fd50-998e-49d4-b673-38f2d4d814d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.072963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef6fd50-998e-49d4-b673-38f2d4d814d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.073868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6fd50-998e-49d4-b673-38f2d4d814d4 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=29e517f2741c4f14877ba49d5be2229a) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.074313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6fd50-998e-49d4-b673-38f2d4d814d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.075885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef6fd50-998e-49d4-b673-38f2d4d814d4 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.089836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 263/533] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/role_assignments?user.id=29e517f2741c4f14877ba49d5be2229a&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:45.091026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6fd50-998e-49d4-b673-38f2d4d814d4 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.114549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977370c5-ed43-40ba-92ab-57d0780100fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.116210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977370c5-ed43-40ba-92ab-57d0780100fe None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.219446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:45.240258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 271/534] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:45.250705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977370c5-ed43-40ba-92ab-57d0780100fe None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.262664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef6fd50-998e-49d4-b673-38f2d4d814d4 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.286710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:45.299489 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883d386-a0eb-436c-bc93-23bdd48b2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.300106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d386-a0eb-436c-bc93-23bdd48b2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.300384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d386-a0eb-436c-bc93-23bdd48b2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.300657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d386-a0eb-436c-bc93-23bdd48b2ec5 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.301616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d386-a0eb-436c-bc93-23bdd48b2ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.301752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d386-a0eb-436c-bc93-23bdd48b2ec5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.303302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d386-a0eb-436c-bc93-23bdd48b2ec5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.316113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 264/535] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:45.322217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883d386-a0eb-436c-bc93-23bdd48b2ec5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.372709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977370c5-ed43-40ba-92ab-57d0780100fe None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.416049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b682b-c164-47ea-8a2b-a0f7ac248acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.417269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b682b-c164-47ea-8a2b-a0f7ac248acc None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.417574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b682b-c164-47ea-8a2b-a0f7ac248acc None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.417851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6b682b-c164-47ea-8a2b-a0f7ac248acc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.436128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b682b-c164-47ea-8a2b-a0f7ac248acc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.438785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6b682b-c164-47ea-8a2b-a0f7ac248acc None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.447347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883d386-a0eb-436c-bc93-23bdd48b2ec5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-ec6b682b-c164-47ea-8a2b-a0f7ac248acc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:45.458824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:45.459804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:45.460675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:45.460675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:45.460675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:45.461309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 272/536] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:45.470789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b682b-c164-47ea-8a2b-a0f7ac248acc None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.522168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f406f57-d3b1-4baa-88e0-630d3ffbc951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.522801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406f57-d3b1-4baa-88e0-630d3ffbc951 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.523089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406f57-d3b1-4baa-88e0-630d3ffbc951 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.523375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f406f57-d3b1-4baa-88e0-630d3ffbc951 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.524121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f406f57-d3b1-4baa-88e0-630d3ffbc951 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=babdd851ad7b4ba99b5746d8480bc082) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.524438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f406f57-d3b1-4baa-88e0-630d3ffbc951 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.525936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f406f57-d3b1-4baa-88e0-630d3ffbc951 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.531934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:45.543682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 265/537] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/role_assignments?user.id=babdd851ad7b4ba99b5746d8480bc082&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:45.560642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccdddf-8451-4fd6-adbf-4efb4f7faf31 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.560949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccdddf-8451-4fd6-adbf-4efb4f7faf31 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.561187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fccdddf-8451-4fd6-adbf-4efb4f7faf31 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.562660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 266/538] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:45.567782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cab4-c666-4476-b6ab-ed3af056592f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.568069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cab4-c666-4476-b6ab-ed3af056592f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.568343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8159cab4-c666-4476-b6ab-ed3af056592f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.614917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8159cab4-c666-4476-b6ab-ed3af056592f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:45.615917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8159cab4-c666-4476-b6ab-ed3af056592f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:45.625501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6b682b-c164-47ea-8a2b-a0f7ac248acc None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.663238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2d57e-c94a-4950-bb66-67ca4e84b813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.664222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2d57e-c94a-4950-bb66-67ca4e84b813 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.664717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2d57e-c94a-4950-bb66-67ca4e84b813 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.665203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2d57e-c94a-4950-bb66-67ca4e84b813 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.666081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2d57e-c94a-4950-bb66-67ca4e84b813 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:45.666582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2d57e-c94a-4950-bb66-67ca4e84b813 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.668182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c2d57e-c94a-4950-bb66-67ca4e84b813 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.683071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 273/539] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:45.690285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2d57e-c94a-4950-bb66-67ca4e84b813 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:45.719591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:45.748835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 267/540] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:45.841703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:45.850169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2d57e-c94a-4950-bb66-67ca4e84b813 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:45.885473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee573d-7012-46cf-b88f-c860fd3a41e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:45.886434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee573d-7012-46cf-b88f-c860fd3a41e2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:45.886909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee573d-7012-46cf-b88f-c860fd3a41e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:45.887382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee573d-7012-46cf-b88f-c860fd3a41e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:45.894498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee573d-7012-46cf-b88f-c860fd3a41e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:45.896185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baee573d-7012-46cf-b88f-c860fd3a41e2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-baee573d-7012-46cf-b88f-c860fd3a41e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:45.908141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:45.908998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:45.909850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:45.909850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:45.909850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:45.909850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:45.909850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:45.909850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:45.909850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:45.909850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:45.912110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 274/541] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:45.918148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cab4-c666-4476-b6ab-ed3af056592f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:46.039150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8159cab4-c666-4476-b6ab-ed3af056592f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:46.079204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf702e-0281-4d7f-9bf9-c39cf70bba28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:46.080258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf702e-0281-4d7f-9bf9-c39cf70bba28 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:46.080728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf702e-0281-4d7f-9bf9-c39cf70bba28 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:46.081200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf702e-0281-4d7f-9bf9-c39cf70bba28 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:46.082143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf702e-0281-4d7f-9bf9-c39cf70bba28 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:46.082640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf702e-0281-4d7f-9bf9-c39cf70bba28 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:46.084288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf702e-0281-4d7f-9bf9-c39cf70bba28 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:46.096860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 268/542] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:46.103089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee573d-7012-46cf-b88f-c860fd3a41e2 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:46.206789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee573d-7012-46cf-b88f-c860fd3a41e2 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:46.213993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf702e-0281-4d7f-9bf9-c39cf70bba28 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:46.268810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef2dd-286b-461e-826a-4f7cdb560097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:46.270904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef2dd-286b-461e-826a-4f7cdb560097 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:46.274555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef2dd-286b-461e-826a-4f7cdb560097 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:46.275036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ef2dd-286b-461e-826a-4f7cdb560097 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:46.275964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef2dd-286b-461e-826a-4f7cdb560097 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=537d07153d3f4adfb3296c4e8e7084bb) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:46.276492 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef2dd-286b-461e-826a-4f7cdb560097 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:46.278160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ef2dd-286b-461e-826a-4f7cdb560097 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:46.280024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:46.291932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 275/543] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:46 2022] GET /identity/v3/role_assignments?user.id=537d07153d3f4adfb3296c4e8e7084bb&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:46.357160 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf702e-0281-4d7f-9bf9-c39cf70bba28 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:46.407509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac629e-b674-4865-aefb-6f7bc729a520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:46.408161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac629e-b674-4865-aefb-6f7bc729a520 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:46.408442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac629e-b674-4865-aefb-6f7bc729a520 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:46.408720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ac629e-b674-4865-aefb-6f7bc729a520 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:46.423955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ac629e-b674-4865-aefb-6f7bc729a520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-a6ac629e-b674-4865-aefb-6f7bc729a520 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:46.429915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:46.430796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:46.431591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 269/544] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:46.439402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef2dd-286b-461e-826a-4f7cdb560097 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:46.467569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:46.554658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ef2dd-286b-461e-826a-4f7cdb560097 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:46.591528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bbd7c-987f-4fd6-9687-66f94050dc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:46.592134 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bbd7c-987f-4fd6-9687-66f94050dc88 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:46.592413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bbd7c-987f-4fd6-9687-66f94050dc88 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:46.593204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bbd7c-987f-4fd6-9687-66f94050dc88 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:46.593904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bbd7c-987f-4fd6-9687-66f94050dc88 None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:46.594208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bbd7c-987f-4fd6-9687-66f94050dc88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:46.595580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677bbd7c-987f-4fd6-9687-66f94050dc88 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:46.604073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 276/545] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:46.609628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac629e-b674-4865-aefb-6f7bc729a520 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:46.763113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:46.767655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ac629e-b674-4865-aefb-6f7bc729a520 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:46.813575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdda96-8701-49a5-a096-0dfa1a36f794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:46.814206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdda96-8701-49a5-a096-0dfa1a36f794 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:46.814482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdda96-8701-49a5-a096-0dfa1a36f794 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:46.814752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdda96-8701-49a5-a096-0dfa1a36f794 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:46.831103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdda96-8701-49a5-a096-0dfa1a36f794 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:46.832547 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bdda96-8701-49a5-a096-0dfa1a36f794 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-e4bdda96-8701-49a5-a096-0dfa1a36f794 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:46.847071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:46.847987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:46.848821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:46.848821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:46.848821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:46.848821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 270/546] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:46.854037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bbd7c-987f-4fd6-9687-66f94050dc88 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:46.977265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:47.005100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bbd7c-987f-4fd6-9687-66f94050dc88 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.047788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6568de3-a766-4e15-aa7f-56dc403d6a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.048316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6568de3-a766-4e15-aa7f-56dc403d6a25 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.048594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6568de3-a766-4e15-aa7f-56dc403d6a25 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.048863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6568de3-a766-4e15-aa7f-56dc403d6a25 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.049535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6568de3-a766-4e15-aa7f-56dc403d6a25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:47.049835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6568de3-a766-4e15-aa7f-56dc403d6a25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:47.051214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6568de3-a766-4e15-aa7f-56dc403d6a25 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:47.068051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 277/547] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:47.073589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdda96-8701-49a5-a096-0dfa1a36f794 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:47.091162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253dc8-b3b6-40a7-bb90-0331b247d459 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.091460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253dc8-b3b6-40a7-bb90-0331b247d459 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.091723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99253dc8-b3b6-40a7-bb90-0331b247d459 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.093253 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 278/548] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:47.098387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1df1c-25a0-43d0-8f98-1c212ff372ff None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.098891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1df1c-25a0-43d0-8f98-1c212ff372ff None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.099360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b1df1c-25a0-43d0-8f98-1c212ff372ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.118130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-81b1df1c-25a0-43d0-8f98-1c212ff372ff None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:47.119746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-81b1df1c-25a0-43d0-8f98-1c212ff372ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:47.231422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 279/549] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:47.244359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdda96-8701-49a5-a096-0dfa1a36f794 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.279891 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a8126-97c8-4d4a-a67c-2f4e10ffc47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.281098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a8126-97c8-4d4a-a67c-2f4e10ffc47c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.281653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a8126-97c8-4d4a-a67c-2f4e10ffc47c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.281653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a8126-97c8-4d4a-a67c-2f4e10ffc47c None admin] PATH_INFO: `/v3/users/swift` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.289637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a8126-97c8-4d4a-a67c-2f4e10ffc47c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:47.291149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a8126-97c8-4d4a-a67c-2f4e10ffc47c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-716a8126-97c8-4d4a-a67c-2f4e10ffc47c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:47.302773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:47.304356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:47.305975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 271/550] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/users/swift => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:47.310531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1df1c-25a0-43d0-8f98-1c212ff372ff None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:47.399512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:47.440210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b1df1c-25a0-43d0-8f98-1c212ff372ff None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.475301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b805ba-07ca-491d-9461-5dd40b09f261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.475925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b805ba-07ca-491d-9461-5dd40b09f261 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.476200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b805ba-07ca-491d-9461-5dd40b09f261 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.476469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b805ba-07ca-491d-9461-5dd40b09f261 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.477348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b805ba-07ca-491d-9461-5dd40b09f261 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:47.477679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b805ba-07ca-491d-9461-5dd40b09f261 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:47.479275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b805ba-07ca-491d-9461-5dd40b09f261 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:47.499494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 280/551] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:47.506669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a8126-97c8-4d4a-a67c-2f4e10ffc47c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:47.519754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:47.640807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a8126-97c8-4d4a-a67c-2f4e10ffc47c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.675207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1f4df5-10c0-4894-b27d-c7ce4263bc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.676249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f4df5-10c0-4894-b27d-c7ce4263bc9b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.676735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f4df5-10c0-4894-b27d-c7ce4263bc9b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.677202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1f4df5-10c0-4894-b27d-c7ce4263bc9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.693777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b805ba-07ca-491d-9461-5dd40b09f261 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:47.756611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f4df5-10c0-4894-b27d-c7ce4263bc9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:47.758155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1f4df5-10c0-4894-b27d-c7ce4263bc9b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:47.781883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:47.867411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b805ba-07ca-491d-9461-5dd40b09f261 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:47.867686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 272/552] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:47.868768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9460cf-2f0c-4fae-9d7d-a00851768f47 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.869112 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9460cf-2f0c-4fae-9d7d-a00851768f47 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.869394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9460cf-2f0c-4fae-9d7d-a00851768f47 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.870833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 273/553] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:47.876480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9460cf-2f0c-4fae-9d7d-a00851768f47 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:47.909022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:47.921616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad66667-d221-4fd5-93cd-424d1a1b46a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:47.922895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad66667-d221-4fd5-93cd-424d1a1b46a9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.923602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad66667-d221-4fd5-93cd-424d1a1b46a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.924068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad66667-d221-4fd5-93cd-424d1a1b46a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.938465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad66667-d221-4fd5-93cd-424d1a1b46a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-bad66667-d221-4fd5-93cd-424d1a1b46a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:47.944989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:47.946066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:47.946881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:47.949824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 281/554] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:47.951204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78996fc-a3d4-4e6a-bc81-10e338a2f2be None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:47.951615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78996fc-a3d4-4e6a-bc81-10e338a2f2be None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:47.952530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78996fc-a3d4-4e6a-bc81-10e338a2f2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:47.976183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a78996fc-a3d4-4e6a-bc81-10e338a2f2be None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:47.977884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a78996fc-a3d4-4e6a-bc81-10e338a2f2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:47.990167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9460cf-2f0c-4fae-9d7d-a00851768f47 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.013786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.031152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a2658-9dcb-4aef-814f-cd21a9cce1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.031746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a2658-9dcb-4aef-814f-cd21a9cce1b1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.032105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a2658-9dcb-4aef-814f-cd21a9cce1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.032386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a2658-9dcb-4aef-814f-cd21a9cce1b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.048430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a2658-9dcb-4aef-814f-cd21a9cce1b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.050327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a2658-9dcb-4aef-814f-cd21a9cce1b1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.071493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 282/555] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:48.072873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78996fc-a3d4-4e6a-bc81-10e338a2f2be None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-ec4a2658-9dcb-4aef-814f-cd21a9cce1b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:48.081728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:48.082650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:48.084116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:48.084116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:48.084116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:48.084116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 274/556] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:48.090605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a2658-9dcb-4aef-814f-cd21a9cce1b1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.267061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78996fc-a3d4-4e6a-bc81-10e338a2f2be None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.279444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a2658-9dcb-4aef-814f-cd21a9cce1b1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.307941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.340252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1eccbc-a1ff-4dce-9b55-1088a0cdb24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.343511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eccbc-a1ff-4dce-9b55-1088a0cdb24b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.344246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eccbc-a1ff-4dce-9b55-1088a0cdb24b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.345155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1eccbc-a1ff-4dce-9b55-1088a0cdb24b None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.345928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422bdd8-f5c1-42cc-8ba4-8fe7f6741525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.346971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422bdd8-f5c1-42cc-8ba4-8fe7f6741525 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.347412 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422bdd8-f5c1-42cc-8ba4-8fe7f6741525 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.348240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eccbc-a1ff-4dce-9b55-1088a0cdb24b None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:48.348659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6422bdd8-f5c1-42cc-8ba4-8fe7f6741525 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.349486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422bdd8-f5c1-42cc-8ba4-8fe7f6741525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:48.349930 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422bdd8-f5c1-42cc-8ba4-8fe7f6741525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.350071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eccbc-a1ff-4dce-9b55-1088a0cdb24b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.351522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1eccbc-a1ff-4dce-9b55-1088a0cdb24b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.351854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6422bdd8-f5c1-42cc-8ba4-8fe7f6741525 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.361759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 283/557] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:48.363002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f9538-80ed-4086-ae43-e2810f8fb2a7 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.363288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f9538-80ed-4086-ae43-e2810f8fb2a7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.363543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f9538-80ed-4086-ae43-e2810f8fb2a7 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.367907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 275/558] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:48.369435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 284/559] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:48.369849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422bdd8-f5c1-42cc-8ba4-8fe7f6741525 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.370731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e9aa4-9543-413e-be44-a44dc9527a4b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.371032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e9aa4-9543-413e-be44-a44dc9527a4b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.371289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e9aa4-9543-413e-be44-a44dc9527a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.393104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-761e9aa4-9543-413e-be44-a44dc9527a4b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:48.394635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-761e9aa4-9543-413e-be44-a44dc9527a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:48.405973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.488275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 285/560] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:48.488275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e9aa4-9543-413e-be44-a44dc9527a4b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.506814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6422bdd8-f5c1-42cc-8ba4-8fe7f6741525 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.548350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98210ee8-9fbf-4850-99e2-b2abaf99a25b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.549251 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98210ee8-9fbf-4850-99e2-b2abaf99a25b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.549885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98210ee8-9fbf-4850-99e2-b2abaf99a25b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.550525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98210ee8-9fbf-4850-99e2-b2abaf99a25b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.562427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98210ee8-9fbf-4850-99e2-b2abaf99a25b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.564207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98210ee8-9fbf-4850-99e2-b2abaf99a25b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-98210ee8-9fbf-4850-99e2-b2abaf99a25b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:48.583073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:48.584231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:48.585317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:48.585317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:48.585317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:48.587171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 276/561] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:48.588518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98210ee8-9fbf-4850-99e2-b2abaf99a25b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.598074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761e9aa4-9543-413e-be44-a44dc9527a4b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.621515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.674142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd4bc3-0b4e-40e4-85ee-d3e8aa4addf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.674852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd4bc3-0b4e-40e4-85ee-d3e8aa4addf1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.675128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd4bc3-0b4e-40e4-85ee-d3e8aa4addf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.675398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dd4bc3-0b4e-40e4-85ee-d3e8aa4addf1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.691453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd4bc3-0b4e-40e4-85ee-d3e8aa4addf1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.693271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dd4bc3-0b4e-40e4-85ee-d3e8aa4addf1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-18dd4bc3-0b4e-40e4-85ee-d3e8aa4addf1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:48.718118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:48.719021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:48.719870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:48.719870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:48.719870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:48.719870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:48.719870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:48.719870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:48.719870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:48.719870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:48.725737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 286/562] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:48.726564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd4bc3-0b4e-40e4-85ee-d3e8aa4addf1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.734202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.771957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98210ee8-9fbf-4850-99e2-b2abaf99a25b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.813597 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04529-d94f-4d92-9f03-3c2ce6eff760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.814151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04529-d94f-4d92-9f03-3c2ce6eff760 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.814430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04529-d94f-4d92-9f03-3c2ce6eff760 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.814703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f04529-d94f-4d92-9f03-3c2ce6eff760 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.825308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f04529-d94f-4d92-9f03-3c2ce6eff760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-97f04529-d94f-4d92-9f03-3c2ce6eff760 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:48.830556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:48.831534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:48.832348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:48.836461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 277/563] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:48.837125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04529-d94f-4d92-9f03-3c2ce6eff760 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.856814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dd4bc3-0b4e-40e4-85ee-d3e8aa4addf1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.892791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0ef8d-e937-4f66-8592-34fb5143b7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.893495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0ef8d-e937-4f66-8592-34fb5143b7e8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.893721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0ef8d-e937-4f66-8592-34fb5143b7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.893993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e0ef8d-e937-4f66-8592-34fb5143b7e8 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.894632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0ef8d-e937-4f66-8592-34fb5143b7e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:48.894933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0ef8d-e937-4f66-8592-34fb5143b7e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.896285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e0ef8d-e937-4f66-8592-34fb5143b7e8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.909965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 287/564] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:48.911193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0ef8d-e937-4f66-8592-34fb5143b7e8 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:48.947750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:48.951546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f04529-d94f-4d92-9f03-3c2ce6eff760 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:48.989970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97b734-6896-41ed-a5d1-dd7136a5f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:48.990578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97b734-6896-41ed-a5d1-dd7136a5f85b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:48.990855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97b734-6896-41ed-a5d1-dd7136a5f85b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:48.991131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97b734-6896-41ed-a5d1-dd7136a5f85b None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:48.991870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97b734-6896-41ed-a5d1-dd7136a5f85b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:48.992210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97b734-6896-41ed-a5d1-dd7136a5f85b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:48.993732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97b734-6896-41ed-a5d1-dd7136a5f85b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:48.995452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.015181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 278/565] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.016063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97b734-6896-41ed-a5d1-dd7136a5f85b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.027448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e0ef8d-e937-4f66-8592-34fb5143b7e8 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.060256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57dd3e4-1c9a-47ac-aa00-550f4e115c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.060874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dd3e4-1c9a-47ac-aa00-550f4e115c40 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.061150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dd3e4-1c9a-47ac-aa00-550f4e115c40 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.062018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57dd3e4-1c9a-47ac-aa00-550f4e115c40 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.071745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57dd3e4-1c9a-47ac-aa00-550f4e115c40 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-e57dd3e4-1c9a-47ac-aa00-550f4e115c40 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:49.076784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.077755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:49.078574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 288/566] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.079287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57dd3e4-1c9a-47ac-aa00-550f4e115c40 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.118637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97b734-6896-41ed-a5d1-dd7136a5f85b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.150867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24913d92-288e-4652-9482-aed1cff9dcb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.151471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24913d92-288e-4652-9482-aed1cff9dcb9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.151743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24913d92-288e-4652-9482-aed1cff9dcb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.152012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24913d92-288e-4652-9482-aed1cff9dcb9 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.152663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24913d92-288e-4652-9482-aed1cff9dcb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.152961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24913d92-288e-4652-9482-aed1cff9dcb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.154352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24913d92-288e-4652-9482-aed1cff9dcb9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.161976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 279/567] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.162740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24913d92-288e-4652-9482-aed1cff9dcb9 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.167826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.177425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57dd3e4-1c9a-47ac-aa00-550f4e115c40 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.211935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0afb47d-d964-4479-9e6b-fe2d04f746b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.212554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb47d-d964-4479-9e6b-fe2d04f746b5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.212828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb47d-d964-4479-9e6b-fe2d04f746b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.213097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0afb47d-d964-4479-9e6b-fe2d04f746b5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.217367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.221012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afb47d-d964-4479-9e6b-fe2d04f746b5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.222489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0afb47d-d964-4479-9e6b-fe2d04f746b5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-d0afb47d-d964-4479-9e6b-fe2d04f746b5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:49.234292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.235221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:49.236155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 289/568] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.236743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6e2dc-16f6-48df-b280-22e14c187044 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.236743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6e2dc-16f6-48df-b280-22e14c187044 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.237193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6e2dc-16f6-48df-b280-22e14c187044 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.238251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 290/569] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:49 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:49.238994 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6e2dc-16f6-48df-b280-22e14c187044 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.265020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24913d92-288e-4652-9482-aed1cff9dcb9 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.297675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70032-e5bb-402f-8663-925ca4a92ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.298268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70032-e5bb-402f-8663-925ca4a92ac7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.298547 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70032-e5bb-402f-8663-925ca4a92ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.298815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa70032-e5bb-402f-8663-925ca4a92ac7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.299537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa70032-e5bb-402f-8663-925ca4a92ac7 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=6247f16e4bf6497183e40a7ed31ff23c) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.299841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa70032-e5bb-402f-8663-925ca4a92ac7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.301290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa70032-e5bb-402f-8663-925ca4a92ac7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.306470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 280/570] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/role_assignments?user.id=6247f16e4bf6497183e40a7ed31ff23c&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.307231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70032-e5bb-402f-8663-925ca4a92ac7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.341309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6e2dc-16f6-48df-b280-22e14c187044 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.378753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd759b7-2fc3-4f05-99d8-00c8d0f46b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.379375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd759b7-2fc3-4f05-99d8-00c8d0f46b27 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.379655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd759b7-2fc3-4f05-99d8-00c8d0f46b27 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.379923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd759b7-2fc3-4f05-99d8-00c8d0f46b27 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.380605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd759b7-2fc3-4f05-99d8-00c8d0f46b27 None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.380904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd759b7-2fc3-4f05-99d8-00c8d0f46b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.382359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd759b7-2fc3-4f05-99d8-00c8d0f46b27 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.391618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 291/571] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.392485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd759b7-2fc3-4f05-99d8-00c8d0f46b27 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.410725 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.442568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa70032-e5bb-402f-8663-925ca4a92ac7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.467196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.489876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffff0e8-5c01-4180-a892-26f3d30b4f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.490829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffff0e8-5c01-4180-a892-26f3d30b4f6a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.491318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffff0e8-5c01-4180-a892-26f3d30b4f6a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.491592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffff0e8-5c01-4180-a892-26f3d30b4f6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.502389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffff0e8-5c01-4180-a892-26f3d30b4f6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.503836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffff0e8-5c01-4180-a892-26f3d30b4f6a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.510862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd759b7-2fc3-4f05-99d8-00c8d0f46b27 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-5ffff0e8-5c01-4180-a892-26f3d30b4f6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:49.519014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.519927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:49.520878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:49.520878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.520878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:49.520878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 281/572] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.522040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f24e52-a021-442f-9a19-36cc3cd7a346 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.522319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f24e52-a021-442f-9a19-36cc3cd7a346 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.522589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f24e52-a021-442f-9a19-36cc3cd7a346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.540714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-41f24e52-a021-442f-9a19-36cc3cd7a346 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:49.541821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-41f24e52-a021-442f-9a19-36cc3cd7a346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:49.552017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801670-f69d-4717-9131-86aa4bd8413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.552627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801670-f69d-4717-9131-86aa4bd8413c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.552908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801670-f69d-4717-9131-86aa4bd8413c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.553179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d801670-f69d-4717-9131-86aa4bd8413c None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.553948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801670-f69d-4717-9131-86aa4bd8413c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.554255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801670-f69d-4717-9131-86aa4bd8413c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.555685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d801670-f69d-4717-9131-86aa4bd8413c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.573630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 292/573] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.574290 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801670-f69d-4717-9131-86aa4bd8413c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.616116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 282/574] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:49.616802 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f24e52-a021-442f-9a19-36cc3cd7a346 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.658385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.692031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d801670-f69d-4717-9131-86aa4bd8413c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.729728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ef82b-2ffc-493b-a31e-7e920ac5c5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.730359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ef82b-2ffc-493b-a31e-7e920ac5c5ff None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.730699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ef82b-2ffc-493b-a31e-7e920ac5c5ff None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.730977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ef82b-2ffc-493b-a31e-7e920ac5c5ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.741344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ef82b-2ffc-493b-a31e-7e920ac5c5ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.742873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624ef82b-2ffc-493b-a31e-7e920ac5c5ff None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.756315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f24e52-a021-442f-9a19-36cc3cd7a346 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.757969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-624ef82b-2ffc-493b-a31e-7e920ac5c5ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:49.759586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.760714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:49.761680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:49.761680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.761680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:49.766195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 293/575] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.767093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ef82b-2ffc-493b-a31e-7e920ac5c5ff None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.795337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6486fe-b1bc-489f-a48e-1f8ad34c459b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.796584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6486fe-b1bc-489f-a48e-1f8ad34c459b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.796865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6486fe-b1bc-489f-a48e-1f8ad34c459b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.797139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6486fe-b1bc-489f-a48e-1f8ad34c459b None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.797811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6486fe-b1bc-489f-a48e-1f8ad34c459b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.798112 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6486fe-b1bc-489f-a48e-1f8ad34c459b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.799662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6486fe-b1bc-489f-a48e-1f8ad34c459b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.812198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 283/576] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.813089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6486fe-b1bc-489f-a48e-1f8ad34c459b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.875114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ef82b-2ffc-493b-a31e-7e920ac5c5ff None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.898982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:49.911252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db862fd-f677-4888-b7db-c9cc2aa0eaff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.911881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db862fd-f677-4888-b7db-c9cc2aa0eaff None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.912161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db862fd-f677-4888-b7db-c9cc2aa0eaff None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.912432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db862fd-f677-4888-b7db-c9cc2aa0eaff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.922735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6486fe-b1bc-489f-a48e-1f8ad34c459b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:49.924282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db862fd-f677-4888-b7db-c9cc2aa0eaff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.925770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db862fd-f677-4888-b7db-c9cc2aa0eaff None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-0db862fd-f677-4888-b7db-c9cc2aa0eaff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:49.940653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:49.946813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:49.947720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:49.947720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:49.947720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:49.947720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 294/577] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:49.947720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db862fd-f677-4888-b7db-c9cc2aa0eaff None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:49.961398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a3620-a28f-45cb-8ea9-08df5ee6da15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:49.962398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a3620-a28f-45cb-8ea9-08df5ee6da15 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:49.962826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a3620-a28f-45cb-8ea9-08df5ee6da15 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:49.963090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3a3620-a28f-45cb-8ea9-08df5ee6da15 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:49.963989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a3620-a28f-45cb-8ea9-08df5ee6da15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:49.964292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a3620-a28f-45cb-8ea9-08df5ee6da15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:49.965683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3a3620-a28f-45cb-8ea9-08df5ee6da15 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:49.982589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 284/578] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:49.982589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a3620-a28f-45cb-8ea9-08df5ee6da15 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.007382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.061200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db862fd-f677-4888-b7db-c9cc2aa0eaff None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.091124 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3a3620-a28f-45cb-8ea9-08df5ee6da15 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.096558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc97c5-b1a3-4ef7-a071-d34832e58a47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.097188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc97c5-b1a3-4ef7-a071-d34832e58a47 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.097497 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc97c5-b1a3-4ef7-a071-d34832e58a47 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.097774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc97c5-b1a3-4ef7-a071-d34832e58a47 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.105704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc97c5-b1a3-4ef7-a071-d34832e58a47 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.107139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc97c5-b1a3-4ef7-a071-d34832e58a47 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-9adc97c5-b1a3-4ef7-a071-d34832e58a47 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:50.118726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.119660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:50.120595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:50.125217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 295/579] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.126020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc97c5-b1a3-4ef7-a071-d34832e58a47 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.128075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fc399-39b8-46ca-88f4-e61fdcb921f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.128804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fc399-39b8-46ca-88f4-e61fdcb921f9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.129083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fc399-39b8-46ca-88f4-e61fdcb921f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.129354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fc399-39b8-46ca-88f4-e61fdcb921f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.140483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272fc399-39b8-46ca-88f4-e61fdcb921f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-272fc399-39b8-46ca-88f4-e61fdcb921f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:50.145182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.146110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 285/580] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.150539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fc399-39b8-46ca-88f4-e61fdcb921f9 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.164511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.236021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.245650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc97c5-b1a3-4ef7-a071-d34832e58a47 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.257106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fc399-39b8-46ca-88f4-e61fdcb921f9 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.282040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa822262-d597-4531-8fde-dcf4f1d34dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.282410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822262-d597-4531-8fde-dcf4f1d34dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.282694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822262-d597-4531-8fde-dcf4f1d34dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.282971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa822262-d597-4531-8fde-dcf4f1d34dc1 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.283615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa822262-d597-4531-8fde-dcf4f1d34dc1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.283946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa822262-d597-4531-8fde-dcf4f1d34dc1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.285485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa822262-d597-4531-8fde-dcf4f1d34dc1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.294369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c92c6-92cc-4e2d-8174-a4acc1d4d68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.295308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c92c6-92cc-4e2d-8174-a4acc1d4d68f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.295854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c92c6-92cc-4e2d-8174-a4acc1d4d68f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.296326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c92c6-92cc-4e2d-8174-a4acc1d4d68f None admin] PATH_INFO: `/v3/users/glance` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.308236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 296/581] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.308236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa822262-d597-4531-8fde-dcf4f1d34dc1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.308513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c92c6-92cc-4e2d-8174-a4acc1d4d68f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.308513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c92c6-92cc-4e2d-8174-a4acc1d4d68f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-f50c92c6-92cc-4e2d-8174-a4acc1d4d68f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:50.321717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.322676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 286/582] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.323617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c92c6-92cc-4e2d-8174-a4acc1d4d68f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.424499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.428878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c92c6-92cc-4e2d-8174-a4acc1d4d68f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.433161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa822262-d597-4531-8fde-dcf4f1d34dc1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.465509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8caf55-2ed8-428b-80f6-b705d3bc909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.466121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8caf55-2ed8-428b-80f6-b705d3bc909a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.466398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8caf55-2ed8-428b-80f6-b705d3bc909a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.466669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8caf55-2ed8-428b-80f6-b705d3bc909a None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.467334 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8caf55-2ed8-428b-80f6-b705d3bc909a None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.468170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8caf55-2ed8-428b-80f6-b705d3bc909a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.469635 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8caf55-2ed8-428b-80f6-b705d3bc909a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.473846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d8999-12aa-4b9f-afbe-ab56b838db8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.474511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8999-12aa-4b9f-afbe-ab56b838db8c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.475032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8999-12aa-4b9f-afbe-ab56b838db8c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.475139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d8999-12aa-4b9f-afbe-ab56b838db8c None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.475844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8999-12aa-4b9f-afbe-ab56b838db8c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.476232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8999-12aa-4b9f-afbe-ab56b838db8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.477637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d8999-12aa-4b9f-afbe-ab56b838db8c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.482889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 287/583] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.482889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8caf55-2ed8-428b-80f6-b705d3bc909a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.483864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.502896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 297/584] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.503738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d8999-12aa-4b9f-afbe-ab56b838db8c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.592388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8caf55-2ed8-428b-80f6-b705d3bc909a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.612854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d8999-12aa-4b9f-afbe-ab56b838db8c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.626663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267b39e-0523-4d8d-ba8c-55d239b5c382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.627299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267b39e-0523-4d8d-ba8c-55d239b5c382 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.627583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267b39e-0523-4d8d-ba8c-55d239b5c382 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.627847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8267b39e-0523-4d8d-ba8c-55d239b5c382 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.634663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267b39e-0523-4d8d-ba8c-55d239b5c382 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.636126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8267b39e-0523-4d8d-ba8c-55d239b5c382 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-8267b39e-0523-4d8d-ba8c-55d239b5c382 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:50.648569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.649541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.650440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:50.650440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:50.650440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:50.650440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:50.650440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:50.650440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:50.650440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:50.650440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:50.650440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 288/585] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.651052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267b39e-0523-4d8d-ba8c-55d239b5c382 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.659819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2879be-11a6-441c-8864-efd91da10144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.660612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2879be-11a6-441c-8864-efd91da10144 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.661115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2879be-11a6-441c-8864-efd91da10144 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.661654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2879be-11a6-441c-8864-efd91da10144 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.663068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2879be-11a6-441c-8864-efd91da10144 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.663624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2879be-11a6-441c-8864-efd91da10144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.665102 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2879be-11a6-441c-8864-efd91da10144 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.688538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 298/586] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.688538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2879be-11a6-441c-8864-efd91da10144 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.705328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.724763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.764873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8267b39e-0523-4d8d-ba8c-55d239b5c382 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.798980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b76a0f-9816-4fb9-9eff-0d65989fdc19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.799604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b76a0f-9816-4fb9-9eff-0d65989fdc19 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.799856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2879be-11a6-441c-8864-efd91da10144 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.799971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b76a0f-9816-4fb9-9eff-0d65989fdc19 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.800143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b76a0f-9816-4fb9-9eff-0d65989fdc19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.811094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b76a0f-9816-4fb9-9eff-0d65989fdc19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.812603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b76a0f-9816-4fb9-9eff-0d65989fdc19 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-91b76a0f-9816-4fb9-9eff-0d65989fdc19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:50.826642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.828062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:50.828943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:50.828943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.828943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:50.828943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 289/587] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.829624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b76a0f-9816-4fb9-9eff-0d65989fdc19 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.840664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409089f-738f-44d5-b935-9fb7b0ae3f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.841299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409089f-738f-44d5-b935-9fb7b0ae3f66 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.841618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409089f-738f-44d5-b935-9fb7b0ae3f66 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.841891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a409089f-738f-44d5-b935-9fb7b0ae3f66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.852296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409089f-738f-44d5-b935-9fb7b0ae3f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.853766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a409089f-738f-44d5-b935-9fb7b0ae3f66 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-a409089f-738f-44d5-b935-9fb7b0ae3f66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:50.869276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:50.870261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:50.875943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:50.875943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:50.875943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:50.875943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 299/588] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:50.875943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409089f-738f-44d5-b935-9fb7b0ae3f66 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:50.936889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.944536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b76a0f-9816-4fb9-9eff-0d65989fdc19 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.960897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:50.980759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a409089f-738f-44d5-b935-9fb7b0ae3f66 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:50.980971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecb3b4-6a94-4b51-980a-73a55fb13bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:50.981860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb3b4-6a94-4b51-980a-73a55fb13bc8 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:50.981860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb3b4-6a94-4b51-980a-73a55fb13bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:50.982118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb3b4-6a94-4b51-980a-73a55fb13bc8 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:50.982763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecb3b4-6a94-4b51-980a-73a55fb13bc8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:50.983075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecb3b4-6a94-4b51-980a-73a55fb13bc8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:50.985294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecb3b4-6a94-4b51-980a-73a55fb13bc8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:50.998129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 290/589] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:50.999069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecb3b4-6a94-4b51-980a-73a55fb13bc8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.029317 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633807-ad8c-43dc-a46b-8044993ef94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.030526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633807-ad8c-43dc-a46b-8044993ef94f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.030811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633807-ad8c-43dc-a46b-8044993ef94f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.031088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3633807-ad8c-43dc-a46b-8044993ef94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.042105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3633807-ad8c-43dc-a46b-8044993ef94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.043555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3633807-ad8c-43dc-a46b-8044993ef94f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-d3633807-ad8c-43dc-a46b-8044993ef94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:51.058385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:51.059343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:51.065424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:51.065424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:51.065424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:51.065424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 300/590] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:51.065424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633807-ad8c-43dc-a46b-8044993ef94f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.113739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecb3b4-6a94-4b51-980a-73a55fb13bc8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.150251 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2741bee-4c2b-4db6-af8b-06e9a0a3f6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.150859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2741bee-4c2b-4db6-af8b-06e9a0a3f6cd None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.151137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2741bee-4c2b-4db6-af8b-06e9a0a3f6cd None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.151526 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2741bee-4c2b-4db6-af8b-06e9a0a3f6cd None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.152169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2741bee-4c2b-4db6-af8b-06e9a0a3f6cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.152474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2741bee-4c2b-4db6-af8b-06e9a0a3f6cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.153907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2741bee-4c2b-4db6-af8b-06e9a0a3f6cd None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.163618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3633807-ad8c-43dc-a46b-8044993ef94f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.167080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 291/591] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.168034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2741bee-4c2b-4db6-af8b-06e9a0a3f6cd None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.181280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.202305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9342-cf4f-4fa1-9d3f-fa6bb0a47606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.202959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9342-cf4f-4fa1-9d3f-fa6bb0a47606 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.203241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9342-cf4f-4fa1-9d3f-fa6bb0a47606 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.203519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1c9342-cf4f-4fa1-9d3f-fa6bb0a47606 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.204160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9342-cf4f-4fa1-9d3f-fa6bb0a47606 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.204463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9342-cf4f-4fa1-9d3f-fa6bb0a47606 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.205974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1c9342-cf4f-4fa1-9d3f-fa6bb0a47606 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.206559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.225063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 301/592] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.225063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9342-cf4f-4fa1-9d3f-fa6bb0a47606 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.282007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2741bee-4c2b-4db6-af8b-06e9a0a3f6cd None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.315985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ac49-1736-4b0f-98a4-4d368ef2aea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.316790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ac49-1736-4b0f-98a4-4d368ef2aea1 None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.317084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ac49-1736-4b0f-98a4-4d368ef2aea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.317347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b8ac49-1736-4b0f-98a4-4d368ef2aea1 None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/2dbd23de9096446091fb9b7f79f047fc/roles/0262a124652e4e13a6dc455c2cc2ffb7` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.331407 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1c9342-cf4f-4fa1-9d3f-fa6bb0a47606 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.335702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8ac49-1736-4b0f-98a4-4d368ef2aea1 None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=2dbd23de9096446091fb9b7f79f047fc, role_id=0262a124652e4e13a6dc455c2cc2ffb7)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.337161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b8ac49-1736-4b0f-98a4-4d368ef2aea1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.363484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 292/593] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:51 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/2dbd23de9096446091fb9b7f79f047fc/roles/0262a124652e4e13a6dc455c2cc2ffb7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:51.363484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ac49-1736-4b0f-98a4-4d368ef2aea1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.369878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b888bf-4adc-4c78-8fa5-54b5be433b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.370500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b888bf-4adc-4c78-8fa5-54b5be433b4b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.370825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b888bf-4adc-4c78-8fa5-54b5be433b4b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.371103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b888bf-4adc-4c78-8fa5-54b5be433b4b None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.371764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b888bf-4adc-4c78-8fa5-54b5be433b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.372069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b888bf-4adc-4c78-8fa5-54b5be433b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.373567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b888bf-4adc-4c78-8fa5-54b5be433b4b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.393451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 302/594] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.394442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b888bf-4adc-4c78-8fa5-54b5be433b4b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.449712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.502167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.522161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b8ac49-1736-4b0f-98a4-4d368ef2aea1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.551017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b888bf-4adc-4c78-8fa5-54b5be433b4b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.566798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd313d-6275-4518-902e-c075247b013b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.567442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd313d-6275-4518-902e-c075247b013b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.567725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd313d-6275-4518-902e-c075247b013b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.567999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccd313d-6275-4518-902e-c075247b013b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.575557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd313d-6275-4518-902e-c075247b013b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.577575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccd313d-6275-4518-902e-c075247b013b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.587838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b1d2e7-461f-458f-bbce-bf3e5b6fe557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.588725 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1d2e7-461f-458f-bbce-bf3e5b6fe557 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.589004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1d2e7-461f-458f-bbce-bf3e5b6fe557 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.589274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b1d2e7-461f-458f-bbce-bf3e5b6fe557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-4ccd313d-6275-4518-902e-c075247b013b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:51.589868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:51.590806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:51.591799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 293/595] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/users/neutron => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:51.593513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd313d-6275-4518-902e-c075247b013b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.597103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1d2e7-461f-458f-bbce-bf3e5b6fe557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.598330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b1d2e7-461f-458f-bbce-bf3e5b6fe557 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-a3b1d2e7-461f-458f-bbce-bf3e5b6fe557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:51.609654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:51.610530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:51.611428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:51.611428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:51.611428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:51.611428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:51.611428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:51.611428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:51.611428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:51.611428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:51.611428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 303/596] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:51.611937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8836f-9385-4202-8ecb-f881560772d1 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.612621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8836f-9385-4202-8ecb-f881560772d1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.612621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8836f-9385-4202-8ecb-f881560772d1 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.613902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 304/597] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:51.617526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8836f-9385-4202-8ecb-f881560772d1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.713220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccd313d-6275-4518-902e-c075247b013b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.728413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.737158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8836f-9385-4202-8ecb-f881560772d1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.748961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00e4c5-0c13-455e-be13-4f70d06d31ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.749618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00e4c5-0c13-455e-be13-4f70d06d31ca None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.749898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00e4c5-0c13-455e-be13-4f70d06d31ca None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.750167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a00e4c5-0c13-455e-be13-4f70d06d31ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.757151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00e4c5-0c13-455e-be13-4f70d06d31ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.758582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a00e4c5-0c13-455e-be13-4f70d06d31ca None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-9a00e4c5-0c13-455e-be13-4f70d06d31ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:51.769927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:51.771104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:51.771977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:51.771977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:51.771977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:51.771977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:51.771977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:51.771977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:51.771977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:51.771977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:51.771977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 294/598] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:51.772461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00e4c5-0c13-455e-be13-4f70d06d31ca None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.778056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ec804-afd0-4fad-a3ab-42d4b2e593a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.778680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ec804-afd0-4fad-a3ab-42d4b2e593a3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.778961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ec804-afd0-4fad-a3ab-42d4b2e593a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.779237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ec804-afd0-4fad-a3ab-42d4b2e593a3 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.780499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ec804-afd0-4fad-a3ab-42d4b2e593a3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.780811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ec804-afd0-4fad-a3ab-42d4b2e593a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.782264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ec804-afd0-4fad-a3ab-42d4b2e593a3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.782501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:51.804908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 305/599] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.804908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56fc0a-e881-40dd-8bec-92540f6ab8bc None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.804908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56fc0a-e881-40dd-8bec-92540f6ab8bc None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.804908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c56fc0a-e881-40dd-8bec-92540f6ab8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.820472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8c56fc0a-e881-40dd-8bec-92540f6ab8bc None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:51.821778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8c56fc0a-e881-40dd-8bec-92540f6ab8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:51.886905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a00e4c5-0c13-455e-be13-4f70d06d31ca None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:51.897438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 306/600] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:51.897438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56fc0a-e881-40dd-8bec-92540f6ab8bc None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:51.927025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050826e-5e07-4b17-b7e4-36ea66be6baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:51.927797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050826e-5e07-4b17-b7e4-36ea66be6baf None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:51.928177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050826e-5e07-4b17-b7e4-36ea66be6baf None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:51.928521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050826e-5e07-4b17-b7e4-36ea66be6baf None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:51.929274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050826e-5e07-4b17-b7e4-36ea66be6baf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:51.929682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050826e-5e07-4b17-b7e4-36ea66be6baf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:51.931237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050826e-5e07-4b17-b7e4-36ea66be6baf None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:51.945066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 295/601] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:51.950269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050826e-5e07-4b17-b7e4-36ea66be6baf None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.011505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.019637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.035324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c56fc0a-e881-40dd-8bec-92540f6ab8bc None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.057819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050826e-5e07-4b17-b7e4-36ea66be6baf None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.081798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc536e88-2d32-4763-8e03-ce76ae21f5d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.082949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536e88-2d32-4763-8e03-ce76ae21f5d4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.083840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536e88-2d32-4763-8e03-ce76ae21f5d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.084308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc536e88-2d32-4763-8e03-ce76ae21f5d4 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.085482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc536e88-2d32-4763-8e03-ce76ae21f5d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:52.086242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc536e88-2d32-4763-8e03-ce76ae21f5d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.088852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc536e88-2d32-4763-8e03-ce76ae21f5d4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.095384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c8f3f-15a5-418c-9ac7-df01a3cf55ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.096139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c8f3f-15a5-418c-9ac7-df01a3cf55ea None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.096479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c8f3f-15a5-418c-9ac7-df01a3cf55ea None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.096865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c8f3f-15a5-418c-9ac7-df01a3cf55ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.104709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 307/602] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:52.105740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc536e88-2d32-4763-8e03-ce76ae21f5d4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.113428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c8f3f-15a5-418c-9ac7-df01a3cf55ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.115090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c8f3f-15a5-418c-9ac7-df01a3cf55ea None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-431c8f3f-15a5-418c-9ac7-df01a3cf55ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:52.132830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:52.133878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:52.134766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:52.134766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:52.134766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:52.134766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 296/603] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:52.135024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c8f3f-15a5-418c-9ac7-df01a3cf55ea None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.225015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc536e88-2d32-4763-8e03-ce76ae21f5d4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.244938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c8f3f-15a5-418c-9ac7-df01a3cf55ea None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.262289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.262533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048808a-15a9-425d-b3eb-f895982dc38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.263175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048808a-15a9-425d-b3eb-f895982dc38f None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.263451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048808a-15a9-425d-b3eb-f895982dc38f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.263723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f048808a-15a9-425d-b3eb-f895982dc38f None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/29e517f2741c4f14877ba49d5be2229a/roles/0262a124652e4e13a6dc455c2cc2ffb7` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.281283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f748041-155f-4f86-b9bf-044fd9c9a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.281711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048808a-15a9-425d-b3eb-f895982dc38f None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=29e517f2741c4f14877ba49d5be2229a, role_id=0262a124652e4e13a6dc455c2cc2ffb7)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.282006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748041-155f-4f86-b9bf-044fd9c9a107 None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.282284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748041-155f-4f86-b9bf-044fd9c9a107 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.282555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f748041-155f-4f86-b9bf-044fd9c9a107 None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/babdd851ad7b4ba99b5746d8480bc082/roles/0262a124652e4e13a6dc455c2cc2ffb7` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.283190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f048808a-15a9-425d-b3eb-f895982dc38f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.286155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.298623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 308/604] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:52 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/29e517f2741c4f14877ba49d5be2229a/roles/0262a124652e4e13a6dc455c2cc2ffb7 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:52.299460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048808a-15a9-425d-b3eb-f895982dc38f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.299806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f748041-155f-4f86-b9bf-044fd9c9a107 None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=babdd851ad7b4ba99b5746d8480bc082, role_id=0262a124652e4e13a6dc455c2cc2ffb7)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.301353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f748041-155f-4f86-b9bf-044fd9c9a107 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.325507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 297/605] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:52 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/babdd851ad7b4ba99b5746d8480bc082/roles/0262a124652e4e13a6dc455c2cc2ffb7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:52.328653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f748041-155f-4f86-b9bf-044fd9c9a107 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.515631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f048808a-15a9-425d-b3eb-f895982dc38f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.548271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f748041-155f-4f86-b9bf-044fd9c9a107 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.570554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811698d4-8a39-4505-a304-576b18d73317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.571573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811698d4-8a39-4505-a304-576b18d73317 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.572057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811698d4-8a39-4505-a304-576b18d73317 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.572670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811698d4-8a39-4505-a304-576b18d73317 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.573521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811698d4-8a39-4505-a304-576b18d73317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:52.574011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811698d4-8a39-4505-a304-576b18d73317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.575747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811698d4-8a39-4505-a304-576b18d73317 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.587131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291b1d7-eb9e-47ce-a40b-e47128c2c608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.587842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291b1d7-eb9e-47ce-a40b-e47128c2c608 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.588188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291b1d7-eb9e-47ce-a40b-e47128c2c608 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.588793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291b1d7-eb9e-47ce-a40b-e47128c2c608 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.590088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 309/606] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:52.597635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811698d4-8a39-4505-a304-576b18d73317 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.603501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291b1d7-eb9e-47ce-a40b-e47128c2c608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-0291b1d7-eb9e-47ce-a40b-e47128c2c608 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:52.608550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:52.609529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:52.610358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 298/607] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:52.615987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291b1d7-eb9e-47ce-a40b-e47128c2c608 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.648443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.661135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.719456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811698d4-8a39-4505-a304-576b18d73317 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.756863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330884af-5758-4987-906a-9c28925d1ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.757540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330884af-5758-4987-906a-9c28925d1ddb None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.757818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330884af-5758-4987-906a-9c28925d1ddb None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.758089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330884af-5758-4987-906a-9c28925d1ddb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.766250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330884af-5758-4987-906a-9c28925d1ddb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.767622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330884af-5758-4987-906a-9c28925d1ddb None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-330884af-5758-4987-906a-9c28925d1ddb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:52.780823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:52.781783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:52.782760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:52.782760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:52.782760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:52.782760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:52.782760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:52.782760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:52.782760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:52.782760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:52.782760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 310/608] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:52.787877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330884af-5758-4987-906a-9c28925d1ddb None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.827475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291b1d7-eb9e-47ce-a40b-e47128c2c608 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.898746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330884af-5758-4987-906a-9c28925d1ddb None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:52.913518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:52.927310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf418f-f323-4cdc-9bc3-47a708d4e5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.928990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf418f-f323-4cdc-9bc3-47a708d4e5a2 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.929766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf418f-f323-4cdc-9bc3-47a708d4e5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.930306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cf418f-f323-4cdc-9bc3-47a708d4e5a2 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.932011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf418f-f323-4cdc-9bc3-47a708d4e5a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:52.932796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf418f-f323-4cdc-9bc3-47a708d4e5a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.934740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cf418f-f323-4cdc-9bc3-47a708d4e5a2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.943621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779c42-fe9b-4bde-9251-6011fe8e2511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:52.943621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779c42-fe9b-4bde-9251-6011fe8e2511 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:52.943621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779c42-fe9b-4bde-9251-6011fe8e2511 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:52.943621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779c42-fe9b-4bde-9251-6011fe8e2511 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:52.943997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5779c42-fe9b-4bde-9251-6011fe8e2511 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:52.943997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5779c42-fe9b-4bde-9251-6011fe8e2511 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:52.943997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5779c42-fe9b-4bde-9251-6011fe8e2511 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:52.962928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 299/609] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:52.968890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf418f-f323-4cdc-9bc3-47a708d4e5a2 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:52.971946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 311/610] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:52.973846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779c42-fe9b-4bde-9251-6011fe8e2511 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.132545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:53.134771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779c42-fe9b-4bde-9251-6011fe8e2511 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.142887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cf418f-f323-4cdc-9bc3-47a708d4e5a2 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.178113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a365c-8c15-414a-a48c-f1261821c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.178757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a365c-8c15-414a-a48c-f1261821c07d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.179033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a365c-8c15-414a-a48c-f1261821c07d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.179304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a365c-8c15-414a-a48c-f1261821c07d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.199170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a365c-8c15-414a-a48c-f1261821c07d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.200640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a365c-8c15-414a-a48c-f1261821c07d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.206031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097663d-6a0a-4c47-836d-fe46dd990092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.206697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097663d-6a0a-4c47-836d-fe46dd990092 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.206971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097663d-6a0a-4c47-836d-fe46dd990092 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.207244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097663d-6a0a-4c47-836d-fe46dd990092 None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/537d07153d3f4adfb3296c4e8e7084bb/roles/0262a124652e4e13a6dc455c2cc2ffb7` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-4f3a365c-8c15-414a-a48c-f1261821c07d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:53.231747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:53.232745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:53.234149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:53.234149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:53.234149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:53.235529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 300/611] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:53.237240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097663d-6a0a-4c47-836d-fe46dd990092 None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=537d07153d3f4adfb3296c4e8e7084bb, role_id=0262a124652e4e13a6dc455c2cc2ffb7)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.238713 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b097663d-6a0a-4c47-836d-fe46dd990092 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.243336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a365c-8c15-414a-a48c-f1261821c07d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.264240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 312/612] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:52 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/537d07153d3f4adfb3296c4e8e7084bb/roles/0262a124652e4e13a6dc455c2cc2ffb7 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:53.379780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a365c-8c15-414a-a48c-f1261821c07d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.427095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d996a-329b-4dee-b390-c6b3714e3ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.427784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d996a-329b-4dee-b390-c6b3714e3ea9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.428076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d996a-329b-4dee-b390-c6b3714e3ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.428343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78d996a-329b-4dee-b390-c6b3714e3ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.428998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d996a-329b-4dee-b390-c6b3714e3ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:53.429298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d996a-329b-4dee-b390-c6b3714e3ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.437426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78d996a-329b-4dee-b390-c6b3714e3ea9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.449905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 301/613] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:53.458664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097663d-6a0a-4c47-836d-fe46dd990092 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.507471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:53.603312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097663d-6a0a-4c47-836d-fe46dd990092 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.643007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef38fc5-ae7e-4e9f-9ff5-3d08c47cbec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.643645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef38fc5-ae7e-4e9f-9ff5-3d08c47cbec2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.643925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef38fc5-ae7e-4e9f-9ff5-3d08c47cbec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.644198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef38fc5-ae7e-4e9f-9ff5-3d08c47cbec2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.652321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef38fc5-ae7e-4e9f-9ff5-3d08c47cbec2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.653804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef38fc5-ae7e-4e9f-9ff5-3d08c47cbec2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-bef38fc5-ae7e-4e9f-9ff5-3d08c47cbec2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:53.667591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:53.668608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:53.669601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 313/614] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:53 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:53.674353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d996a-329b-4dee-b390-c6b3714e3ea9 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.677222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:53.814183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d87df-8143-48d5-9202-129973edc539 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.814509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d87df-8143-48d5-9202-129973edc539 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.814718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d87df-8143-48d5-9202-129973edc539 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.816183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 314/615] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:35:53.821549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52a32-c12c-4cc2-8906-c79c03a886ef None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.822082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52a32-c12c-4cc2-8906-c79c03a886ef None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.822561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b52a32-c12c-4cc2-8906-c79c03a886ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.828943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78d996a-329b-4dee-b390-c6b3714e3ea9 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:53.859115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-14b52a32-c12c-4cc2-8906-c79c03a886ef None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:53.860877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-14b52a32-c12c-4cc2-8906-c79c03a886ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:53.902092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fe503-0a3b-44c2-aed7-d05294dce67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:53.903077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fe503-0a3b-44c2-aed7-d05294dce67b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:53.903570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fe503-0a3b-44c2-aed7-d05294dce67b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:53.904059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01fe503-0a3b-44c2-aed7-d05294dce67b None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:53.905628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fe503-0a3b-44c2-aed7-d05294dce67b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:53.906141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fe503-0a3b-44c2-aed7-d05294dce67b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:53.907786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01fe503-0a3b-44c2-aed7-d05294dce67b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:53.929289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 302/616] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 17 00:35:53 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:53.939660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fe503-0a3b-44c2-aed7-d05294dce67b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:53.998022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 315/617] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:54.037831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.093467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01fe503-0a3b-44c2-aed7-d05294dce67b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.136396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f827e5c-5b8e-4007-b93a-52b5cf26e33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.137042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f827e5c-5b8e-4007-b93a-52b5cf26e33a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.137324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f827e5c-5b8e-4007-b93a-52b5cf26e33a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.137614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f827e5c-5b8e-4007-b93a-52b5cf26e33a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.148231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f827e5c-5b8e-4007-b93a-52b5cf26e33a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.149709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f827e5c-5b8e-4007-b93a-52b5cf26e33a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-6f827e5c-5b8e-4007-b93a-52b5cf26e33a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:54.168140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:54.169110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:54.170033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:54.170033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:54.170033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:54.170033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 303/618] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:54.178340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b52a32-c12c-4cc2-8906-c79c03a886ef None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.196410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.307629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b52a32-c12c-4cc2-8906-c79c03a886ef None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.350786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f827e5c-5b8e-4007-b93a-52b5cf26e33a None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.372043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29684d77-7174-488a-b1a7-35567e0ea1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.372666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29684d77-7174-488a-b1a7-35567e0ea1b8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.372944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29684d77-7174-488a-b1a7-35567e0ea1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.373216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29684d77-7174-488a-b1a7-35567e0ea1b8 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.376074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29684d77-7174-488a-b1a7-35567e0ea1b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:54.376381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29684d77-7174-488a-b1a7-35567e0ea1b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.377784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29684d77-7174-488a-b1a7-35567e0ea1b8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:54.405308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 316/619] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:54.410131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29684d77-7174-488a-b1a7-35567e0ea1b8 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.505246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f827e5c-5b8e-4007-b93a-52b5cf26e33a None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.521772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.543500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6443659-03e5-46af-b83e-d9534f3d9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.544132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6443659-03e5-46af-b83e-d9534f3d9479 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.544413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6443659-03e5-46af-b83e-d9534f3d9479 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.544673 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6443659-03e5-46af-b83e-d9534f3d9479 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.555805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.561425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6443659-03e5-46af-b83e-d9534f3d9479 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-f6443659-03e5-46af-b83e-d9534f3d9479 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:54.562931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:54.564119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:54.565034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 304/620] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:35:54.573889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6443659-03e5-46af-b83e-d9534f3d9479 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.617503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29684d77-7174-488a-b1a7-35567e0ea1b8 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.690141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ee57-f8e6-4d6b-bab5-0ba0f1323e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.691182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ee57-f8e6-4d6b-bab5-0ba0f1323e5d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.691670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ee57-f8e6-4d6b-bab5-0ba0f1323e5d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.692144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6632ee57-f8e6-4d6b-bab5-0ba0f1323e5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.705301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632ee57-f8e6-4d6b-bab5-0ba0f1323e5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.712259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6632ee57-f8e6-4d6b-bab5-0ba0f1323e5d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-6632ee57-f8e6-4d6b-bab5-0ba0f1323e5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:54.729821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:54.730745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:54.731631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:54.731631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:54.731631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:54.731631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:54.731631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:54.731631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:54.731631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:54.731631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:54.734544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 317/621] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:54.740090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ee57-f8e6-4d6b-bab5-0ba0f1323e5d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.765597 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6443659-03e5-46af-b83e-d9534f3d9479 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.808119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69aaaf-f885-408e-bc6d-6391bc908bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.808728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69aaaf-f885-408e-bc6d-6391bc908bbc None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.809013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69aaaf-f885-408e-bc6d-6391bc908bbc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.809287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69aaaf-f885-408e-bc6d-6391bc908bbc None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.810005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69aaaf-f885-408e-bc6d-6391bc908bbc None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:54.810311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69aaaf-f885-408e-bc6d-6391bc908bbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.812234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69aaaf-f885-408e-bc6d-6391bc908bbc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:54.821180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 305/622] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:54.826241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61729ab9-638b-4369-8dde-8e1059d59035 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.826241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61729ab9-638b-4369-8dde-8e1059d59035 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.826241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61729ab9-638b-4369-8dde-8e1059d59035 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.826241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 306/623] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:54.829196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61729ab9-638b-4369-8dde-8e1059d59035 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:54.867039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.890636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6632ee57-f8e6-4d6b-bab5-0ba0f1323e5d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.930396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eabe4f2-f86f-448a-bfba-ebcfa87b1f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.930903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabe4f2-f86f-448a-bfba-ebcfa87b1f5e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.931185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabe4f2-f86f-448a-bfba-ebcfa87b1f5e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.931456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eabe4f2-f86f-448a-bfba-ebcfa87b1f5e None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.932138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabe4f2-f86f-448a-bfba-ebcfa87b1f5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:54.932442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabe4f2-f86f-448a-bfba-ebcfa87b1f5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.933996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eabe4f2-f86f-448a-bfba-ebcfa87b1f5e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:54.935703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:54.943418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61729ab9-638b-4369-8dde-8e1059d59035 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:54.950380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 318/624] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:54.951667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e0c7-606e-433e-a43c-92e530c59564 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.952509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e0c7-606e-433e-a43c-92e530c59564 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.952779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e0c7-606e-433e-a43c-92e530c59564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.972752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b681e0c7-606e-433e-a43c-92e530c59564 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:54.974071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b681e0c7-606e-433e-a43c-92e530c59564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:54.982946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f491-7407-43c1-a7fb-12d07082a1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:54.983982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f491-7407-43c1-a7fb-12d07082a1fc None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:54.984483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f491-7407-43c1-a7fb-12d07082a1fc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:54.984994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f491-7407-43c1-a7fb-12d07082a1fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:54.997586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2f491-7407-43c1-a7fb-12d07082a1fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:54.999868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2f491-7407-43c1-a7fb-12d07082a1fc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-6eb2f491-7407-43c1-a7fb-12d07082a1fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:55.015970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:55.016982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:55.017935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:55.017935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:55.017935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:55.024464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 307/625] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:55.025735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f491-7407-43c1-a7fb-12d07082a1fc None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.052273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 319/626] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:55.053248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681e0c7-606e-433e-a43c-92e530c59564 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.130622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.144087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f491-7407-43c1-a7fb-12d07082a1fc None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.190813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f989d-48d0-4d22-a252-62858612032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.191818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f989d-48d0-4d22-a252-62858612032b None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.192322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f989d-48d0-4d22-a252-62858612032b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.192859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f989d-48d0-4d22-a252-62858612032b None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/6247f16e4bf6497183e40a7ed31ff23c/roles/0262a124652e4e13a6dc455c2cc2ffb7` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.218718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b681e0c7-606e-433e-a43c-92e530c59564 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.230323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f989d-48d0-4d22-a252-62858612032b None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=6247f16e4bf6497183e40a7ed31ff23c, role_id=0262a124652e4e13a6dc455c2cc2ffb7)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:55.232176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f989d-48d0-4d22-a252-62858612032b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.247904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 308/627] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:35:55 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/6247f16e4bf6497183e40a7ed31ff23c/roles/0262a124652e4e13a6dc455c2cc2ffb7 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:35:55.249745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59a35-fab8-408f-a32d-bc7f3addb870 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.250382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59a35-fab8-408f-a32d-bc7f3addb870 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.250868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f59a35-fab8-408f-a32d-bc7f3addb870 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.252855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 309/628] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:55.259494 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924be52c-e2a2-4ed1-8118-b04e8e0236ae None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.260918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.261229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924be52c-e2a2-4ed1-8118-b04e8e0236ae None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.261816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924be52c-e2a2-4ed1-8118-b04e8e0236ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.277034 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5a5b0-83d3-41f7-9f48-3404d73e14c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.277621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5a5b0-83d3-41f7-9f48-3404d73e14c8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.277897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5a5b0-83d3-41f7-9f48-3404d73e14c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.278170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac5a5b0-83d3-41f7-9f48-3404d73e14c8 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.278904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5a5b0-83d3-41f7-9f48-3404d73e14c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:55.279211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5a5b0-83d3-41f7-9f48-3404d73e14c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:55.280696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac5a5b0-83d3-41f7-9f48-3404d73e14c8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.291184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-924be52c-e2a2-4ed1-8118-b04e8e0236ae None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:55.293071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-924be52c-e2a2-4ed1-8118-b04e8e0236ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:55.293960 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 320/629] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:55.302593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5a5b0-83d3-41f7-9f48-3404d73e14c8 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.434208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 310/630] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:35:55.435261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924be52c-e2a2-4ed1-8118-b04e8e0236ae None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.446064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac5a5b0-83d3-41f7-9f48-3404d73e14c8 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.492459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7269d4-6927-474f-a60e-8fbadbac15cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.493813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7269d4-6927-474f-a60e-8fbadbac15cb None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.494841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7269d4-6927-474f-a60e-8fbadbac15cb None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.496269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7269d4-6927-474f-a60e-8fbadbac15cb None admin] PATH_INFO: `/v3/users/nova` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.506902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7269d4-6927-474f-a60e-8fbadbac15cb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:55.508960 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7269d4-6927-474f-a60e-8fbadbac15cb None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-4c7269d4-6927-474f-a60e-8fbadbac15cb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:55.528691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:55.529717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:35:55.531192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:55.532296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 321/631] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:55.537154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7269d4-6927-474f-a60e-8fbadbac15cb None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.538562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.577373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924be52c-e2a2-4ed1-8118-b04e8e0236ae None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.586781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.615729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba830b-37be-4469-acea-eaf32791bab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.616893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba830b-37be-4469-acea-eaf32791bab7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.617381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba830b-37be-4469-acea-eaf32791bab7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.617887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba830b-37be-4469-acea-eaf32791bab7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.629933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba830b-37be-4469-acea-eaf32791bab7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-dbba830b-37be-4469-acea-eaf32791bab7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:55.635370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:55.636288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:55.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:55.644470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 311/632] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:55.646019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba830b-37be-4469-acea-eaf32791bab7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.647266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7269d4-6927-474f-a60e-8fbadbac15cb None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.739046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e2b95-4dc3-4ef3-9819-dad0fff90b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.739752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e2b95-4dc3-4ef3-9819-dad0fff90b63 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.739936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e2b95-4dc3-4ef3-9819-dad0fff90b63 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.740194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e2b95-4dc3-4ef3-9819-dad0fff90b63 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.740936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e2b95-4dc3-4ef3-9819-dad0fff90b63 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:55.741239 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e2b95-4dc3-4ef3-9819-dad0fff90b63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:55.742686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e2b95-4dc3-4ef3-9819-dad0fff90b63 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.756976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba830b-37be-4469-acea-eaf32791bab7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.781095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 322/633] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:55.784456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.786476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e2b95-4dc3-4ef3-9819-dad0fff90b63 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.801770 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b9967-bdcb-4e1d-9dcd-e18751b5667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.802743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b9967-bdcb-4e1d-9dcd-e18751b5667b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.803239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b9967-bdcb-4e1d-9dcd-e18751b5667b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.803710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841b9967-bdcb-4e1d-9dcd-e18751b5667b None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.804578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b9967-bdcb-4e1d-9dcd-e18751b5667b None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:55.805104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b9967-bdcb-4e1d-9dcd-e18751b5667b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:55.806731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841b9967-bdcb-4e1d-9dcd-e18751b5667b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:55.821574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 312/634] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:35:55.823474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b9967-bdcb-4e1d-9dcd-e18751b5667b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:55.938879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841b9967-bdcb-4e1d-9dcd-e18751b5667b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.950219 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e2b95-4dc3-4ef3-9819-dad0fff90b63 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:55.952523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:55.991021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a97a8-483c-46e3-98ca-20eb3a90ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.992011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a97a8-483c-46e3-98ca-20eb3a90ef13 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.992497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a97a8-483c-46e3-98ca-20eb3a90ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.992974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a97a8-483c-46e3-98ca-20eb3a90ef13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:55.993117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92455b1f-8701-4aa9-8172-b763169ff437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:55.993805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92455b1f-8701-4aa9-8172-b763169ff437 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:55.994162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92455b1f-8701-4aa9-8172-b763169ff437 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:55.994451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92455b1f-8701-4aa9-8172-b763169ff437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.008395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a97a8-483c-46e3-98ca-20eb3a90ef13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.010693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74a97a8-483c-46e3-98ca-20eb3a90ef13 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-b74a97a8-483c-46e3-98ca-20eb3a90ef13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:56.031685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:56.032758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:56.033670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:56.033670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.033670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:56.038607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 313/635] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:56.038607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a97a8-483c-46e3-98ca-20eb3a90ef13 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.077651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92455b1f-8701-4aa9-8172-b763169ff437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.079227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92455b1f-8701-4aa9-8172-b763169ff437 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.080426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.141583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74a97a8-483c-46e3-98ca-20eb3a90ef13 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.178111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db3b7d-296e-437d-8d00-a284d7f61286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.178746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db3b7d-296e-437d-8d00-a284d7f61286 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.179030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db3b7d-296e-437d-8d00-a284d7f61286 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.179301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8db3b7d-296e-437d-8d00-a284d7f61286 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.189865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8db3b7d-296e-437d-8d00-a284d7f61286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-d8db3b7d-296e-437d-8d00-a284d7f61286 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:56.195168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:56.196133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:56.196981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:56.198681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 323/636] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:56.200027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d5b7-99b9-4c91-81f7-3f0da642a5c7 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.200318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d5b7-99b9-4c91-81f7-3f0da642a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.200599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5d5b7-99b9-4c91-81f7-3f0da642a5c7 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.201216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 314/637] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:56.205445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 324/638] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:56.205592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db3b7d-296e-437d-8d00-a284d7f61286 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.206168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5d5b7-99b9-4c91-81f7-3f0da642a5c7 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.206574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.309141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5d5b7-99b9-4c91-81f7-3f0da642a5c7 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.313128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.316051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8db3b7d-296e-437d-8d00-a284d7f61286 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.344795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740477fb-3cbc-4eb6-9dfb-32fa382f945f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.345449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740477fb-3cbc-4eb6-9dfb-32fa382f945f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.345740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740477fb-3cbc-4eb6-9dfb-32fa382f945f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.346045 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740477fb-3cbc-4eb6-9dfb-32fa382f945f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.353190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b8a13-cb5f-46eb-850d-e1ec3143ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.354023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b8a13-cb5f-46eb-850d-e1ec3143ec19 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.354503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b8a13-cb5f-46eb-850d-e1ec3143ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.354926 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b8a13-cb5f-46eb-850d-e1ec3143ec19 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.355718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b8a13-cb5f-46eb-850d-e1ec3143ec19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:56.356133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740477fb-3cbc-4eb6-9dfb-32fa382f945f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.356340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b8a13-cb5f-46eb-850d-e1ec3143ec19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.357603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740477fb-3cbc-4eb6-9dfb-32fa382f945f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.358237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b8a13-cb5f-46eb-850d-e1ec3143ec19 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.370158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 315/639] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:56.371115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b8a13-cb5f-46eb-850d-e1ec3143ec19 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-740477fb-3cbc-4eb6-9dfb-32fa382f945f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:56.371990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:56.372928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:56.374393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:56.374393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.374393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:56.378000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 325/640] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:56.379443 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed719f-6251-4a44-b63d-c4902d3a09a8 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.379739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed719f-6251-4a44-b63d-c4902d3a09a8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.380017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed719f-6251-4a44-b63d-c4902d3a09a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.398287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-45ed719f-6251-4a44-b63d-c4902d3a09a8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:56.399482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-45ed719f-6251-4a44-b63d-c4902d3a09a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:56.461853 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.481848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 326/641] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:56.483020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed719f-6251-4a44-b63d-c4902d3a09a8 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.483228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b8a13-cb5f-46eb-850d-e1ec3143ec19 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.532083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549b63-72b7-4f1a-b7d0-0131a0f6d255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.532618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549b63-72b7-4f1a-b7d0-0131a0f6d255 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.532893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549b63-72b7-4f1a-b7d0-0131a0f6d255 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.533159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34549b63-72b7-4f1a-b7d0-0131a0f6d255 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.533839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549b63-72b7-4f1a-b7d0-0131a0f6d255 None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:56.534135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549b63-72b7-4f1a-b7d0-0131a0f6d255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.535487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34549b63-72b7-4f1a-b7d0-0131a0f6d255 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.549451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 316/642] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:56.549451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549b63-72b7-4f1a-b7d0-0131a0f6d255 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.579541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.626514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed719f-6251-4a44-b63d-c4902d3a09a8 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.667936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a040f-7d42-42fb-9263-5a973c5456f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.669542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a040f-7d42-42fb-9263-5a973c5456f7 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.670051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a040f-7d42-42fb-9263-5a973c5456f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.670568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2a040f-7d42-42fb-9263-5a973c5456f7 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.676247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34549b63-72b7-4f1a-b7d0-0131a0f6d255 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.680132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a040f-7d42-42fb-9263-5a973c5456f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.681981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2a040f-7d42-42fb-9263-5a973c5456f7 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-8e2a040f-7d42-42fb-9263-5a973c5456f7 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:56.695809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:56.696804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:35:56.697791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:56.700865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 327/643] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:56.702876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a040f-7d42-42fb-9263-5a973c5456f7 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.713218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b317ce-2f67-4eb1-8d0c-f9ad341202d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.714124 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b317ce-2f67-4eb1-8d0c-f9ad341202d5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.714386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b317ce-2f67-4eb1-8d0c-f9ad341202d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.714660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b317ce-2f67-4eb1-8d0c-f9ad341202d5 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.715304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b317ce-2f67-4eb1-8d0c-f9ad341202d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:56.715643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b317ce-2f67-4eb1-8d0c-f9ad341202d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.717720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b317ce-2f67-4eb1-8d0c-f9ad341202d5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.737871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 317/644] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:56.737871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b317ce-2f67-4eb1-8d0c-f9ad341202d5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.766008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.824084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:56.825532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2a040f-7d42-42fb-9263-5a973c5456f7 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.849162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b317ce-2f67-4eb1-8d0c-f9ad341202d5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:56.860625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db37d6-4997-4ec6-a837-5545dd6ed8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.861259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db37d6-4997-4ec6-a837-5545dd6ed8ab None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.861586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db37d6-4997-4ec6-a837-5545dd6ed8ab None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.861865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88db37d6-4997-4ec6-a837-5545dd6ed8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.872592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db37d6-4997-4ec6-a837-5545dd6ed8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.874668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88db37d6-4997-4ec6-a837-5545dd6ed8ab None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-88db37d6-4997-4ec6-a837-5545dd6ed8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:56.888815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:56.889993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:56.891241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:56.891241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:56.891241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:56.892427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598222c3-aaea-4785-8948-1f5925a034a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:56.893202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598222c3-aaea-4785-8948-1f5925a034a3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:56.893676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598222c3-aaea-4785-8948-1f5925a034a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:56.894091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598222c3-aaea-4785-8948-1f5925a034a3 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:56.894734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 328/645] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:56.895119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598222c3-aaea-4785-8948-1f5925a034a3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:56.895553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db37d6-4997-4ec6-a837-5545dd6ed8ab None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:56.895723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598222c3-aaea-4785-8948-1f5925a034a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:56.897280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598222c3-aaea-4785-8948-1f5925a034a3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:56.918582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 318/646] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:56.919646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598222c3-aaea-4785-8948-1f5925a034a3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.002100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.009003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88db37d6-4997-4ec6-a837-5545dd6ed8ab None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.023728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598222c3-aaea-4785-8948-1f5925a034a3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.045993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743073-0105-41b7-9670-c66f555a40e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.046731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743073-0105-41b7-9670-c66f555a40e0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.047126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743073-0105-41b7-9670-c66f555a40e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.047402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44743073-0105-41b7-9670-c66f555a40e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.054659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44743073-0105-41b7-9670-c66f555a40e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.056093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44743073-0105-41b7-9670-c66f555a40e0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.057448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b7b5-bfe6-45d3-ad73-f2ed6393b8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.058194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b7b5-bfe6-45d3-ad73-f2ed6393b8df None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.058606 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b7b5-bfe6-45d3-ad73-f2ed6393b8df None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.058887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8669b7b5-bfe6-45d3-ad73-f2ed6393b8df None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.066854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-44743073-0105-41b7-9670-c66f555a40e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:57.069246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.070275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.071177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:57.071177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:57.071177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:57.071177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:57.071177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:57.071177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:57.071177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:57.071177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:57.071603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8669b7b5-bfe6-45d3-ad73-f2ed6393b8df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:57.072882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 329/647] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.073842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743073-0105-41b7-9670-c66f555a40e0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-8669b7b5-bfe6-45d3-ad73-f2ed6393b8df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:57.075669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.076540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:57.077985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 319/648] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.078671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b7b5-bfe6-45d3-ad73-f2ed6393b8df None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.181017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8669b7b5-bfe6-45d3-ad73-f2ed6393b8df None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.186914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44743073-0105-41b7-9670-c66f555a40e0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.214959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bba48-6c6d-4dc9-8250-ef9fab0982ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.215568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bba48-6c6d-4dc9-8250-ef9fab0982ae None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.215852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bba48-6c6d-4dc9-8250-ef9fab0982ae None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.216129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287bba48-6c6d-4dc9-8250-ef9fab0982ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.223839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564c9a8-2e41-4985-82d5-2eb5648fffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.224642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c9a8-2e41-4985-82d5-2eb5648fffa1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.225228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c9a8-2e41-4985-82d5-2eb5648fffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.225544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564c9a8-2e41-4985-82d5-2eb5648fffa1 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.226178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564c9a8-2e41-4985-82d5-2eb5648fffa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:57.226482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564c9a8-2e41-4985-82d5-2eb5648fffa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.227835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6564c9a8-2e41-4985-82d5-2eb5648fffa1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.244633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 330/649] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:57.244633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564c9a8-2e41-4985-82d5-2eb5648fffa1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.262597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.289561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.293552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bba48-6c6d-4dc9-8250-ef9fab0982ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.295969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287bba48-6c6d-4dc9-8250-ef9fab0982ae None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.354966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6564c9a8-2e41-4985-82d5-2eb5648fffa1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.394455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998459e-af93-45bd-8017-226a3fb5d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.395134 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998459e-af93-45bd-8017-226a3fb5d4fb None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.395419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998459e-af93-45bd-8017-226a3fb5d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.395749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998459e-af93-45bd-8017-226a3fb5d4fb None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.396464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998459e-af93-45bd-8017-226a3fb5d4fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:57.396781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998459e-af93-45bd-8017-226a3fb5d4fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.402521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 320/650] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:57.402722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998459e-af93-45bd-8017-226a3fb5d4fb None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.402834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bba48-6c6d-4dc9-8250-ef9fab0982ae None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.415455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 331/651] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:57.416210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998459e-af93-45bd-8017-226a3fb5d4fb None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.515796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.516456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.519524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287bba48-6c6d-4dc9-8250-ef9fab0982ae None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.540870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998459e-af93-45bd-8017-226a3fb5d4fb None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.555759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73061b-e1bf-46b0-8b85-b4d2e8c82975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.556367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73061b-e1bf-46b0-8b85-b4d2e8c82975 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.556646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73061b-e1bf-46b0-8b85-b4d2e8c82975 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.557023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73061b-e1bf-46b0-8b85-b4d2e8c82975 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.557608 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73061b-e1bf-46b0-8b85-b4d2e8c82975 None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:57.557919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73061b-e1bf-46b0-8b85-b4d2e8c82975 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.559280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73061b-e1bf-46b0-8b85-b4d2e8c82975 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.567857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 321/652] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:57.568516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73061b-e1bf-46b0-8b85-b4d2e8c82975 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.575612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d41d97-3090-4908-a076-34c15e2c5a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.576233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d41d97-3090-4908-a076-34c15e2c5a44 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.576510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d41d97-3090-4908-a076-34c15e2c5a44 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.576808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d41d97-3090-4908-a076-34c15e2c5a44 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.584151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d41d97-3090-4908-a076-34c15e2c5a44 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.585607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d41d97-3090-4908-a076-34c15e2c5a44 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-05d41d97-3090-4908-a076-34c15e2c5a44 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:57.596627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.597778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 332/653] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.598786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d41d97-3090-4908-a076-34c15e2c5a44 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.672525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73061b-e1bf-46b0-8b85-b4d2e8c82975 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.694906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d41d97-3090-4908-a076-34c15e2c5a44 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.709869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077330a6-c51b-421e-ac99-62e72a66deb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.710513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077330a6-c51b-421e-ac99-62e72a66deb0 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.711697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077330a6-c51b-421e-ac99-62e72a66deb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.711981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077330a6-c51b-421e-ac99-62e72a66deb0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.722982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077330a6-c51b-421e-ac99-62e72a66deb0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.724441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077330a6-c51b-421e-ac99-62e72a66deb0 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.732730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25aea-1c24-411c-9033-7fe06bfb1206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.733359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25aea-1c24-411c-9033-7fe06bfb1206 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.733667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25aea-1c24-411c-9033-7fe06bfb1206 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.733933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd25aea-1c24-411c-9033-7fe06bfb1206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.734653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25aea-1c24-411c-9033-7fe06bfb1206 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=2dbd23de9096446091fb9b7f79f047fc) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:57.734957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25aea-1c24-411c-9033-7fe06bfb1206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.736359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd25aea-1c24-411c-9033-7fe06bfb1206 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-077330a6-c51b-421e-ac99-62e72a66deb0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:57.738375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.739343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:57.740224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:57.740224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.740224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:57.740405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.740670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 322/654] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.740780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb04d1-0c55-4c88-81d9-8a2f5351e6f7 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.741056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb04d1-0c55-4c88-81d9-8a2f5351e6f7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.741330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cb04d1-0c55-4c88-81d9-8a2f5351e6f7 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.742592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 323/655] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:35:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:35:57.743279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb04d1-0c55-4c88-81d9-8a2f5351e6f7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.746911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 333/656] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/role_assignments?user.id=2dbd23de9096446091fb9b7f79f047fc&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:57.747714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25aea-1c24-411c-9033-7fe06bfb1206 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.760609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:57.859762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cb04d1-0c55-4c88-81d9-8a2f5351e6f7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.867751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd25aea-1c24-411c-9033-7fe06bfb1206 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:57.901543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad924e8b-776c-4be6-a824-318600e22908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.902254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924e8b-776c-4be6-a824-318600e22908 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.902538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924e8b-776c-4be6-a824-318600e22908 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.902811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad924e8b-776c-4be6-a824-318600e22908 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.904508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927e0f-3d63-4da8-aff7-00e69babe38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:57.905700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927e0f-3d63-4da8-aff7-00e69babe38d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.905977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927e0f-3d63-4da8-aff7-00e69babe38d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.906248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b927e0f-3d63-4da8-aff7-00e69babe38d None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.906997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b927e0f-3d63-4da8-aff7-00e69babe38d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:57.907302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b927e0f-3d63-4da8-aff7-00e69babe38d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.908741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b927e0f-3d63-4da8-aff7-00e69babe38d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.915204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad924e8b-776c-4be6-a824-318600e22908 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:57.916752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad924e8b-776c-4be6-a824-318600e22908 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:57.929124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 334/657] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:57.930271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927e0f-3d63-4da8-aff7-00e69babe38d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-ad924e8b-776c-4be6-a824-318600e22908 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:57.932825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:57.933787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:57.934672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:57.934672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:57.934672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:57.934672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 324/658] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:57.936662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509e448-4f6b-41d6-8970-cc1dac0cbc47 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:57.936662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509e448-4f6b-41d6-8970-cc1dac0cbc47 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:57.936662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2509e448-4f6b-41d6-8970-cc1dac0cbc47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:57.956911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2509e448-4f6b-41d6-8970-cc1dac0cbc47 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:35:57.958191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2509e448-4f6b-41d6-8970-cc1dac0cbc47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:35:58.007154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.028341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.041436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 325/659] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:35:58.041436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509e448-4f6b-41d6-8970-cc1dac0cbc47 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.058405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b927e0f-3d63-4da8-aff7-00e69babe38d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.097714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5cc6-c9b3-4b30-8411-8ee5a3d06389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.098839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5cc6-c9b3-4b30-8411-8ee5a3d06389 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.099117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5cc6-c9b3-4b30-8411-8ee5a3d06389 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.099535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c5cc6-c9b3-4b30-8411-8ee5a3d06389 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.100296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5cc6-c9b3-4b30-8411-8ee5a3d06389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.100603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5cc6-c9b3-4b30-8411-8ee5a3d06389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.102902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c5cc6-c9b3-4b30-8411-8ee5a3d06389 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.118244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 335/660] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.119063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5cc6-c9b3-4b30-8411-8ee5a3d06389 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.154281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2509e448-4f6b-41d6-8970-cc1dac0cbc47 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.191502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaddb06-23eb-4e0d-9bf3-c54fd1c5c0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.192109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddb06-23eb-4e0d-9bf3-c54fd1c5c0b0 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.192383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddb06-23eb-4e0d-9bf3-c54fd1c5c0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.192655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaddb06-23eb-4e0d-9bf3-c54fd1c5c0b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.242641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c5cc6-c9b3-4b30-8411-8ee5a3d06389 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.265231 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.275581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.285605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaddb06-23eb-4e0d-9bf3-c54fd1c5c0b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.285765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10bb2f-8370-4137-a936-163a73be38cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.286312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10bb2f-8370-4137-a936-163a73be38cf None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.286592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10bb2f-8370-4137-a936-163a73be38cf None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.286866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10bb2f-8370-4137-a936-163a73be38cf None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.287517 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10bb2f-8370-4137-a936-163a73be38cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.287822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10bb2f-8370-4137-a936-163a73be38cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.288601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaddb06-23eb-4e0d-9bf3-c54fd1c5c0b0 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.289176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10bb2f-8370-4137-a936-163a73be38cf None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.302367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 336/661] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.303355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10bb2f-8370-4137-a936-163a73be38cf None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.408355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 326/662] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:58.409172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10bb2f-8370-4137-a936-163a73be38cf None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.409758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaddb06-23eb-4e0d-9bf3-c54fd1c5c0b0 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.453077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e166b-a763-46c1-aed8-338ad6182bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.453757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e166b-a763-46c1-aed8-338ad6182bda None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.454068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e166b-a763-46c1-aed8-338ad6182bda None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.454369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e166b-a763-46c1-aed8-338ad6182bda None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.462883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e166b-a763-46c1-aed8-338ad6182bda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.465012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e166b-a763-46c1-aed8-338ad6182bda None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-851e166b-a763-46c1-aed8-338ad6182bda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:58.479465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:58.480367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:58.481244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:58.481244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:58.481244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:58.481244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:58.481244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:58.481244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:58.481244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:58.481244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:58.481714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 337/663] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:58.482406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e166b-a763-46c1-aed8-338ad6182bda None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.516753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.523656 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaddb06-23eb-4e0d-9bf3-c54fd1c5c0b0 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.524683 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.558202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39254a-f43c-4a10-b8b1-d95e7033579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.558838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39254a-f43c-4a10-b8b1-d95e7033579c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.559114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39254a-f43c-4a10-b8b1-d95e7033579c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.559387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f39254a-f43c-4a10-b8b1-d95e7033579c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.566934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39254a-f43c-4a10-b8b1-d95e7033579c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.568376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f39254a-f43c-4a10-b8b1-d95e7033579c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-5f39254a-f43c-4a10-b8b1-d95e7033579c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:58.579972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:58.580897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 327/664] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:58.582262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39254a-f43c-4a10-b8b1-d95e7033579c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.591893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e166b-a763-46c1-aed8-338ad6182bda None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.629642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344fdf4-af75-4fef-afc1-c77b56d24d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.630285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344fdf4-af75-4fef-afc1-c77b56d24d5f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.630594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344fdf4-af75-4fef-afc1-c77b56d24d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.630895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344fdf4-af75-4fef-afc1-c77b56d24d5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.641123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344fdf4-af75-4fef-afc1-c77b56d24d5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-2344fdf4-af75-4fef-afc1-c77b56d24d5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:35:58.645947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:58.646873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:58.647736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 338/665] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:58.652439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344fdf4-af75-4fef-afc1-c77b56d24d5f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.688931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f39254a-f43c-4a10-b8b1-d95e7033579c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.725371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101769f8-d312-4646-b12f-91fb4f3ec885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.726036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101769f8-d312-4646-b12f-91fb4f3ec885 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.726316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101769f8-d312-4646-b12f-91fb4f3ec885 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.726592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101769f8-d312-4646-b12f-91fb4f3ec885 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.739260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101769f8-d312-4646-b12f-91fb4f3ec885 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.740732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101769f8-d312-4646-b12f-91fb4f3ec885 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-101769f8-d312-4646-b12f-91fb4f3ec885 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:58.757314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:58.758330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:58.759220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:58.759220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:58.759220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:35:58.759220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 328/666] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:58.759220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101769f8-d312-4646-b12f-91fb4f3ec885 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.769700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.772030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:58.773779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344fdf4-af75-4fef-afc1-c77b56d24d5f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.810027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fd707-e721-4a8e-96f0-066a3eef3e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.810642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fd707-e721-4a8e-96f0-066a3eef3e58 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.810977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fd707-e721-4a8e-96f0-066a3eef3e58 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.811883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84fd707-e721-4a8e-96f0-066a3eef3e58 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.812600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fd707-e721-4a8e-96f0-066a3eef3e58 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.812935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fd707-e721-4a8e-96f0-066a3eef3e58 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.814397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84fd707-e721-4a8e-96f0-066a3eef3e58 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.830942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 339/667] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.830942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fd707-e721-4a8e-96f0-066a3eef3e58 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.867195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101769f8-d312-4646-b12f-91fb4f3ec885 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.905829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d92f11-46f5-4409-8d50-716de5640c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.906427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d92f11-46f5-4409-8d50-716de5640c44 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.906703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d92f11-46f5-4409-8d50-716de5640c44 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.906980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d92f11-46f5-4409-8d50-716de5640c44 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.907698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d92f11-46f5-4409-8d50-716de5640c44 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.907999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d92f11-46f5-4409-8d50-716de5640c44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.909523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d92f11-46f5-4409-8d50-716de5640c44 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.934863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 329/668] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.934863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d92f11-46f5-4409-8d50-716de5640c44 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:58.935137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84fd707-e721-4a8e-96f0-066a3eef3e58 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:58.968502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9843766-114f-4645-b7db-ce22f61688ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:58.969047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9843766-114f-4645-b7db-ce22f61688ce None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:58.969357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9843766-114f-4645-b7db-ce22f61688ce None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:58.969705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9843766-114f-4645-b7db-ce22f61688ce None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:58.970987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9843766-114f-4645-b7db-ce22f61688ce None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:58.970987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9843766-114f-4645-b7db-ce22f61688ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:58.972090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9843766-114f-4645-b7db-ce22f61688ce None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:58.985647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 340/669] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:58.985647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9843766-114f-4645-b7db-ce22f61688ce None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.005884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.007035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.050406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d92f11-46f5-4409-8d50-716de5640c44 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.102209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9843766-114f-4645-b7db-ce22f61688ce None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.119189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea75563-0eb5-4e14-9686-c02145897acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.119801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea75563-0eb5-4e14-9686-c02145897acf None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.120080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea75563-0eb5-4e14-9686-c02145897acf None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.120356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea75563-0eb5-4e14-9686-c02145897acf None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.121094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea75563-0eb5-4e14-9686-c02145897acf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:59.121398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea75563-0eb5-4e14-9686-c02145897acf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.122793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea75563-0eb5-4e14-9686-c02145897acf None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.137567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22e961-c157-4c93-80b6-8f99a743e931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.138174 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22e961-c157-4c93-80b6-8f99a743e931 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.138448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22e961-c157-4c93-80b6-8f99a743e931 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.138719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22e961-c157-4c93-80b6-8f99a743e931 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.139481 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22e961-c157-4c93-80b6-8f99a743e931 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=29e517f2741c4f14877ba49d5be2229a) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:59.139776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22e961-c157-4c93-80b6-8f99a743e931 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.141192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22e961-c157-4c93-80b6-8f99a743e931 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.146292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 330/670] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:59.146416 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea75563-0eb5-4e14-9686-c02145897acf None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.157449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 341/671] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:58 2022] GET /identity/v3/role_assignments?user.id=29e517f2741c4f14877ba49d5be2229a&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:59.157449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22e961-c157-4c93-80b6-8f99a743e931 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.267703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea75563-0eb5-4e14-9686-c02145897acf None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.268831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.291341 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22e961-c157-4c93-80b6-8f99a743e931 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.296130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.307128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a95ae8-0064-4de8-8130-6baa9484fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.307576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a95ae8-0064-4de8-8130-6baa9484fb4d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.307858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a95ae8-0064-4de8-8130-6baa9484fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.308132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a95ae8-0064-4de8-8130-6baa9484fb4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.336446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc88b-fba8-4b91-941e-d941856c2674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.337623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc88b-fba8-4b91-941e-d941856c2674 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.338045 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc88b-fba8-4b91-941e-d941856c2674 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.338760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fc88b-fba8-4b91-941e-d941856c2674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.352470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc88b-fba8-4b91-941e-d941856c2674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.354172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fc88b-fba8-4b91-941e-d941856c2674 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-a14fc88b-fba8-4b91-941e-d941856c2674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:59.371919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:59.373177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:59.374707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:59.374707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.374707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:59.375182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 342/672] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:59.375984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc88b-fba8-4b91-941e-d941856c2674 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.386746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a95ae8-0064-4de8-8130-6baa9484fb4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.388212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a95ae8-0064-4de8-8130-6baa9484fb4d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.510982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fc88b-fba8-4b91-941e-d941856c2674 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.511748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 331/673] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:35:59.512668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a95ae8-0064-4de8-8130-6baa9484fb4d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.547542 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.559558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd93c0-ef59-48dd-9369-9b5f989f146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.560578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd93c0-ef59-48dd-9369-9b5f989f146e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.561127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd93c0-ef59-48dd-9369-9b5f989f146e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.561644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bd93c0-ef59-48dd-9369-9b5f989f146e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.565899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.573737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd93c0-ef59-48dd-9369-9b5f989f146e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.576212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37bd93c0-ef59-48dd-9369-9b5f989f146e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-37bd93c0-ef59-48dd-9369-9b5f989f146e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:35:59.592561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:59.593501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:59.594391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:35:59.594391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:35:59.594391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:35:59.594391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:35:59.594391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:35:59.594391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:35:59.594391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:35:59.594391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:59.597470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 343/674] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:59.598505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd93c0-ef59-48dd-9369-9b5f989f146e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.648445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a95ae8-0064-4de8-8130-6baa9484fb4d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.696057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181086d-5f53-41d5-8d2a-5c990ac63de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.697295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181086d-5f53-41d5-8d2a-5c990ac63de3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.697822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181086d-5f53-41d5-8d2a-5c990ac63de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.698499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181086d-5f53-41d5-8d2a-5c990ac63de3 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.699805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181086d-5f53-41d5-8d2a-5c990ac63de3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:59.700307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181086d-5f53-41d5-8d2a-5c990ac63de3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.703006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181086d-5f53-41d5-8d2a-5c990ac63de3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.716857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bd93c0-ef59-48dd-9369-9b5f989f146e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.721976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 332/675] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:59.723038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181086d-5f53-41d5-8d2a-5c990ac63de3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.757241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b155c4-e840-4c50-ad07-b664994756ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.757925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b155c4-e840-4c50-ad07-b664994756ec None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.758202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b155c4-e840-4c50-ad07-b664994756ec None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.758474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b155c4-e840-4c50-ad07-b664994756ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.770289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b155c4-e840-4c50-ad07-b664994756ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.771785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b155c4-e840-4c50-ad07-b664994756ec None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-55b155c4-e840-4c50-ad07-b664994756ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:35:59.786698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:59.787669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:35:59.788550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:35:59.788550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:35:59.788550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:59.788550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 344/676] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:59.789191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b155c4-e840-4c50-ad07-b664994756ec None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.834363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.853071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:35:59.860653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181086d-5f53-41d5-8d2a-5c990ac63de3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.901051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983bbf-1873-4ddb-991b-e7fead2a1a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.901714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983bbf-1873-4ddb-991b-e7fead2a1a50 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.902068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983bbf-1873-4ddb-991b-e7fead2a1a50 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.902414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6983bbf-1873-4ddb-991b-e7fead2a1a50 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.903204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6983bbf-1873-4ddb-991b-e7fead2a1a50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:35:59.903578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6983bbf-1873-4ddb-991b-e7fead2a1a50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.905658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6983bbf-1873-4ddb-991b-e7fead2a1a50 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.918436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 333/677] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:35:59.919402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983bbf-1873-4ddb-991b-e7fead2a1a50 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:35:59.925093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b155c4-e840-4c50-ad07-b664994756ec None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:35:59.963593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e296d-0e4f-42a0-bd0b-78795e77eb0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:35:59.964527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e296d-0e4f-42a0-bd0b-78795e77eb0f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:35:59.965001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e296d-0e4f-42a0-bd0b-78795e77eb0f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:35:59.965482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e296d-0e4f-42a0-bd0b-78795e77eb0f None admin] PATH_INFO: `/v3/users/swift` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:35:59.975142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e296d-0e4f-42a0-bd0b-78795e77eb0f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:35:59.976827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e296d-0e4f-42a0-bd0b-78795e77eb0f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-837e296d-0e4f-42a0-bd0b-78795e77eb0f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:35:59.991663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:35:59.992694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:35:59.993668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 345/678] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:35:59.994300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e296d-0e4f-42a0-bd0b-78795e77eb0f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.025177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6983bbf-1873-4ddb-991b-e7fead2a1a50 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.060322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8565d4-a303-4448-b4e3-0ed296dbdaf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.060943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8565d4-a303-4448-b4e3-0ed296dbdaf1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.061251 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8565d4-a303-4448-b4e3-0ed296dbdaf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.061583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8565d4-a303-4448-b4e3-0ed296dbdaf1 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.062242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8565d4-a303-4448-b4e3-0ed296dbdaf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.062546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8565d4-a303-4448-b4e3-0ed296dbdaf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.063920 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8565d4-a303-4448-b4e3-0ed296dbdaf1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.075644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 334/679] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.076602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6ed47-7637-4b58-8b76-6f2b01d2a2f4 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.076890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6ed47-7637-4b58-8b76-6f2b01d2a2f4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.077165 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6ed47-7637-4b58-8b76-6f2b01d2a2f4 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.078387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 335/680] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:00.079073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6ed47-7637-4b58-8b76-6f2b01d2a2f4 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.088768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.110074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e296d-0e4f-42a0-bd0b-78795e77eb0f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.119898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.147302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a37a1-b62e-491e-82d4-7f71fa872d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.147911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a37a1-b62e-491e-82d4-7f71fa872d98 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.148186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a37a1-b62e-491e-82d4-7f71fa872d98 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.148574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37a37a1-b62e-491e-82d4-7f71fa872d98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.149209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a37a1-b62e-491e-82d4-7f71fa872d98 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=babdd851ad7b4ba99b5746d8480bc082) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.149705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a37a1-b62e-491e-82d4-7f71fa872d98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.151187 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37a37a1-b62e-491e-82d4-7f71fa872d98 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.158067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 346/681] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:35:59 2022] GET /identity/v3/role_assignments?user.id=babdd851ad7b4ba99b5746d8480bc082&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.158478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a37a1-b62e-491e-82d4-7f71fa872d98 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.213543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6ed47-7637-4b58-8b76-6f2b01d2a2f4 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.268320 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d3054b-8c2b-46ab-bf2c-ccd506c6c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.270034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3054b-8c2b-46ab-bf2c-ccd506c6c047 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.270544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3054b-8c2b-46ab-bf2c-ccd506c6c047 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.271025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3054b-8c2b-46ab-bf2c-ccd506c6c047 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.271782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37a37a1-b62e-491e-82d4-7f71fa872d98 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.272210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3054b-8c2b-46ab-bf2c-ccd506c6c047 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.272713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3054b-8c2b-46ab-bf2c-ccd506c6c047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.275753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d3054b-8c2b-46ab-bf2c-ccd506c6c047 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.302501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 336/682] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.304147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96a4bf-71b0-4e08-8b48-686edf85cf16 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.304638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96a4bf-71b0-4e08-8b48-686edf85cf16 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.305118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96a4bf-71b0-4e08-8b48-686edf85cf16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.316761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3546a2-b391-49cf-8243-469d89a6ab14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.317436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3546a2-b391-49cf-8243-469d89a6ab14 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.317717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3546a2-b391-49cf-8243-469d89a6ab14 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.317989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3546a2-b391-49cf-8243-469d89a6ab14 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.327353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3546a2-b391-49cf-8243-469d89a6ab14 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.328805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3546a2-b391-49cf-8243-469d89a6ab14 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.330541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ba96a4bf-71b0-4e08-8b48-686edf85cf16 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:00.332699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ba96a4bf-71b0-4e08-8b48-686edf85cf16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-ea3546a2-b391-49cf-8243-469d89a6ab14 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:00.343059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:00.343951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:00.344826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:00.344826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:00.344826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:00.344826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:00.344826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:00.344826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:00.344826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:00.344826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:00.344826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 347/683] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:00.345319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3546a2-b391-49cf-8243-469d89a6ab14 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.392181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.412120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.428077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 337/684] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:00.429255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96a4bf-71b0-4e08-8b48-686edf85cf16 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.489701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3546a2-b391-49cf-8243-469d89a6ab14 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.533146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aeee6-881b-4517-9317-e047d975ea02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.534076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aeee6-881b-4517-9317-e047d975ea02 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.534668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aeee6-881b-4517-9317-e047d975ea02 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.534948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15aeee6-881b-4517-9317-e047d975ea02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.550348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96a4bf-71b0-4e08-8b48-686edf85cf16 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.592227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53e65-b7b2-4679-8922-14e6e6f756b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.593666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53e65-b7b2-4679-8922-14e6e6f756b7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.594249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53e65-b7b2-4679-8922-14e6e6f756b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.594535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d53e65-b7b2-4679-8922-14e6e6f756b7 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.595522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53e65-b7b2-4679-8922-14e6e6f756b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.595879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53e65-b7b2-4679-8922-14e6e6f756b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.597811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d53e65-b7b2-4679-8922-14e6e6f756b7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.612985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 338/685] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.621179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aeee6-881b-4517-9317-e047d975ea02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.622558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53e65-b7b2-4679-8922-14e6e6f756b7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.622812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15aeee6-881b-4517-9317-e047d975ea02 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.656761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.725108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.742961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 348/686] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:36:00.750881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aeee6-881b-4517-9317-e047d975ea02 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.794840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d53e65-b7b2-4679-8922-14e6e6f756b7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.845121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df613ab-a71c-43ef-947f-a60fdc381121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.846118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df613ab-a71c-43ef-947f-a60fdc381121 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.846521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df613ab-a71c-43ef-947f-a60fdc381121 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.846899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df613ab-a71c-43ef-947f-a60fdc381121 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.848307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df613ab-a71c-43ef-947f-a60fdc381121 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=537d07153d3f4adfb3296c4e8e7084bb) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:00.848794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df613ab-a71c-43ef-947f-a60fdc381121 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.851024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df613ab-a71c-43ef-947f-a60fdc381121 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:00.865433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 339/687] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/role_assignments?user.id=537d07153d3f4adfb3296c4e8e7084bb&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:00.865433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df613ab-a71c-43ef-947f-a60fdc381121 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:00.914989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15aeee6-881b-4517-9317-e047d975ea02 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:00.950470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:00.960348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0946edb-a1d6-46ce-8aa0-bc0d8ceba66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:00.961004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0946edb-a1d6-46ce-8aa0-bc0d8ceba66e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:00.961286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0946edb-a1d6-46ce-8aa0-bc0d8ceba66e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:00.961601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0946edb-a1d6-46ce-8aa0-bc0d8ceba66e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:00.987322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0946edb-a1d6-46ce-8aa0-bc0d8ceba66e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:00.989970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0946edb-a1d6-46ce-8aa0-bc0d8ceba66e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-c0946edb-a1d6-46ce-8aa0-bc0d8ceba66e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:01.010701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:01.011698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:01.012792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:01.012792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:01.012792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:01.012792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 349/688] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:01.020140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0946edb-a1d6-46ce-8aa0-bc0d8ceba66e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.090372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df613ab-a71c-43ef-947f-a60fdc381121 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.115256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.134884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcbf3b-d537-4c85-919f-56da5809d2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.135850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcbf3b-d537-4c85-919f-56da5809d2f4 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.136382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcbf3b-d537-4c85-919f-56da5809d2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.136864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dcbf3b-d537-4c85-919f-56da5809d2f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.148122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dcbf3b-d537-4c85-919f-56da5809d2f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-40dcbf3b-d537-4c85-919f-56da5809d2f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:01.153922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:01.154931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:01.155773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:01.158144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 340/689] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:01.164818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcbf3b-d537-4c85-919f-56da5809d2f4 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.183337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0946edb-a1d6-46ce-8aa0-bc0d8ceba66e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.226984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494101-4167-4e0d-8327-251066f71f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.228331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494101-4167-4e0d-8327-251066f71f96 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.228810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494101-4167-4e0d-8327-251066f71f96 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.229681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c494101-4167-4e0d-8327-251066f71f96 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.230550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494101-4167-4e0d-8327-251066f71f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:01.231327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494101-4167-4e0d-8327-251066f71f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.234025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c494101-4167-4e0d-8327-251066f71f96 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.252475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 350/690] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:01.258179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494101-4167-4e0d-8327-251066f71f96 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.299370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dcbf3b-d537-4c85-919f-56da5809d2f4 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.337106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3e15b-a722-4018-b6ed-e96454d16679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.338530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3e15b-a722-4018-b6ed-e96454d16679 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.339008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3e15b-a722-4018-b6ed-e96454d16679 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.339471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3e15b-a722-4018-b6ed-e96454d16679 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.340345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3e15b-a722-4018-b6ed-e96454d16679 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:01.340840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3e15b-a722-4018-b6ed-e96454d16679 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.342545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3e15b-a722-4018-b6ed-e96454d16679 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.361460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 341/691] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:01.366057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.370456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3e15b-a722-4018-b6ed-e96454d16679 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.389462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c494101-4167-4e0d-8327-251066f71f96 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.462066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d941c-c808-4a35-a313-096415b2e96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.462709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d941c-c808-4a35-a313-096415b2e96c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.462991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d941c-c808-4a35-a313-096415b2e96c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.463514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3d941c-c808-4a35-a313-096415b2e96c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.472540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.477171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d941c-c808-4a35-a313-096415b2e96c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.478667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3d941c-c808-4a35-a313-096415b2e96c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-ba3d941c-c808-4a35-a313-096415b2e96c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:01.500843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:01.501880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:01.502758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:01.502758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:01.502758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:01.502758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:01.502758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:01.502758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:01.502758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:01.502758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:01.503744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 351/692] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:01.510433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d941c-c808-4a35-a313-096415b2e96c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.568609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3e15b-a722-4018-b6ed-e96454d16679 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.609831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfba929-3c95-4208-afdb-8117310f2fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.610496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba929-3c95-4208-afdb-8117310f2fdd None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.610783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba929-3c95-4208-afdb-8117310f2fdd None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.611064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfba929-3c95-4208-afdb-8117310f2fdd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.626913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfba929-3c95-4208-afdb-8117310f2fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.628682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfba929-3c95-4208-afdb-8117310f2fdd None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-bdfba929-3c95-4208-afdb-8117310f2fdd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:01.645044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:01.646022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:01.646892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:01.646892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:01.646892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:01.647536 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3d941c-c808-4a35-a313-096415b2e96c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.647628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 342/693] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:01.648725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd0659-08e7-4fc1-90f7-16c4c6c6b576 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.649017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd0659-08e7-4fc1-90f7-16c4c6c6b576 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.649293 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd0659-08e7-4fc1-90f7-16c4c6c6b576 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.654953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 343/694] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:01.655109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.655780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd0659-08e7-4fc1-90f7-16c4c6c6b576 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.694927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c8343-d731-4eb3-b3c7-866055e51273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.695851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8343-d731-4eb3-b3c7-866055e51273 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.696349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8343-d731-4eb3-b3c7-866055e51273 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.696802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c8343-d731-4eb3-b3c7-866055e51273 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.697700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c8343-d731-4eb3-b3c7-866055e51273 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:01.698190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c8343-d731-4eb3-b3c7-866055e51273 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.700289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857c8343-d731-4eb3-b3c7-866055e51273 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.721441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 352/695] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:01.723738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c9fa-2ff8-46a2-afeb-ea6b7b1c314b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.724228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c9fa-2ff8-46a2-afeb-ea6b7b1c314b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.724748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f9c9fa-2ff8-46a2-afeb-ea6b7b1c314b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.744603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-81f9c9fa-2ff8-46a2-afeb-ea6b7b1c314b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:01.746878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-81f9c9fa-2ff8-46a2-afeb-ea6b7b1c314b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:01.756922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.767225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd0659-08e7-4fc1-90f7-16c4c6c6b576 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.802547 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f038a-1510-4ae2-aae0-642cbb812b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.803312 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f038a-1510-4ae2-aae0-642cbb812b14 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.803655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f038a-1510-4ae2-aae0-642cbb812b14 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.803995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5f038a-1510-4ae2-aae0-642cbb812b14 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:01.804828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f038a-1510-4ae2-aae0-642cbb812b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:01.805197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f038a-1510-4ae2-aae0-642cbb812b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:01.806725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5f038a-1510-4ae2-aae0-642cbb812b14 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:01.824666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 344/696] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:01.824666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f038a-1510-4ae2-aae0-642cbb812b14 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.833545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 353/697] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:01.835169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c9fa-2ff8-46a2-afeb-ea6b7b1c314b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:01.943399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5f038a-1510-4ae2-aae0-642cbb812b14 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.953784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f9c9fa-2ff8-46a2-afeb-ea6b7b1c314b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:01.972030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:01.994119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e707a0c-edc6-449d-b2a0-441526f7ad37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:01.995160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707a0c-edc6-449d-b2a0-441526f7ad37 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:01.995646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707a0c-edc6-449d-b2a0-441526f7ad37 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:01.996146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e707a0c-edc6-449d-b2a0-441526f7ad37 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.004784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e707a0c-edc6-449d-b2a0-441526f7ad37 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.006804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e707a0c-edc6-449d-b2a0-441526f7ad37 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-6e707a0c-edc6-449d-b2a0-441526f7ad37 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:02.020809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:02.021867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:02.022798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:02.025734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 354/698] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:02.032269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e707a0c-edc6-449d-b2a0-441526f7ad37 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.049556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84436b80-1876-4d72-ac6b-06a7592d4511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.050658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84436b80-1876-4d72-ac6b-06a7592d4511 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.052465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84436b80-1876-4d72-ac6b-06a7592d4511 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.052948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84436b80-1876-4d72-ac6b-06a7592d4511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.053959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84436b80-1876-4d72-ac6b-06a7592d4511 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=6247f16e4bf6497183e40a7ed31ff23c) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:02.054476 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84436b80-1876-4d72-ac6b-06a7592d4511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.056177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84436b80-1876-4d72-ac6b-06a7592d4511 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.067247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 345/699] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:01 2022] GET /identity/v3/role_assignments?user.id=6247f16e4bf6497183e40a7ed31ff23c&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:02.167795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e707a0c-edc6-449d-b2a0-441526f7ad37 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.205050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04fc0e-1fee-4c5b-9441-81ea5ffadf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.206023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fc0e-1fee-4c5b-9441-81ea5ffadf60 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.206529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fc0e-1fee-4c5b-9441-81ea5ffadf60 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.207047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da04fc0e-1fee-4c5b-9441-81ea5ffadf60 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.208002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04fc0e-1fee-4c5b-9441-81ea5ffadf60 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:02.208513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04fc0e-1fee-4c5b-9441-81ea5ffadf60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.210178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da04fc0e-1fee-4c5b-9441-81ea5ffadf60 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.236049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84436b80-1876-4d72-ac6b-06a7592d4511 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.241711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 355/700] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:02.249315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04fc0e-1fee-4c5b-9441-81ea5ffadf60 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.273815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.274995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.385642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da04fc0e-1fee-4c5b-9441-81ea5ffadf60 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.396730 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84436b80-1876-4d72-ac6b-06a7592d4511 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.426351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605a3e0-0ae8-4031-afee-da4fdf7f68c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.427340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a3e0-0ae8-4031-afee-da4fdf7f68c1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.427863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a3e0-0ae8-4031-afee-da4fdf7f68c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.428339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1605a3e0-0ae8-4031-afee-da4fdf7f68c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.441016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871fea7-a995-492e-9987-0d9ba0fffa86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.441626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871fea7-a995-492e-9987-0d9ba0fffa86 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.441911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871fea7-a995-492e-9987-0d9ba0fffa86 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.442188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871fea7-a995-492e-9987-0d9ba0fffa86 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.442900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871fea7-a995-492e-9987-0d9ba0fffa86 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.444448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f871fea7-a995-492e-9987-0d9ba0fffa86 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-f871fea7-a995-492e-9987-0d9ba0fffa86 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:02.456768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:02.457886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:02.458837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 346/701] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:02.472241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871fea7-a995-492e-9987-0d9ba0fffa86 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.522891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605a3e0-0ae8-4031-afee-da4fdf7f68c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.524906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1605a3e0-0ae8-4031-afee-da4fdf7f68c1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.542173 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.578637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.602313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f871fea7-a995-492e-9987-0d9ba0fffa86 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.642530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a5337-0971-4f52-a721-10016f3605fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.643151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a5337-0971-4f52-a721-10016f3605fb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.643435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a5337-0971-4f52-a721-10016f3605fb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.643713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a5337-0971-4f52-a721-10016f3605fb None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.644362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a5337-0971-4f52-a721-10016f3605fb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:02.644670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a5337-0971-4f52-a721-10016f3605fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.646121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22a5337-0971-4f52-a721-10016f3605fb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.646354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 356/702] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:36:02.653558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605a3e0-0ae8-4031-afee-da4fdf7f68c1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.655244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 347/703] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:02.660974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a5337-0971-4f52-a721-10016f3605fb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.776024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22a5337-0971-4f52-a721-10016f3605fb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.781552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1605a3e0-0ae8-4031-afee-da4fdf7f68c1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:02.800026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.822675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89496-7017-41e4-89e0-7db952f13268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.823299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89496-7017-41e4-89e0-7db952f13268 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.823579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89496-7017-41e4-89e0-7db952f13268 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.823856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa89496-7017-41e4-89e0-7db952f13268 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.824491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89496-7017-41e4-89e0-7db952f13268 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:02.824796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89496-7017-41e4-89e0-7db952f13268 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.826218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa89496-7017-41e4-89e0-7db952f13268 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.832911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 348/704] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:02.834502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9622cc49-505a-4bb4-822d-b3a6ea9ed39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:02.835401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622cc49-505a-4bb4-822d-b3a6ea9ed39f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.835887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622cc49-505a-4bb4-822d-b3a6ea9ed39f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.836428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9622cc49-505a-4bb4-822d-b3a6ea9ed39f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.849336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622cc49-505a-4bb4-822d-b3a6ea9ed39f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:02.851244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9622cc49-505a-4bb4-822d-b3a6ea9ed39f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-9622cc49-505a-4bb4-822d-b3a6ea9ed39f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:02.869338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:02.870359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:02.871263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:02.871263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:02.871263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:02.873616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 357/705] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:02.881590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89496-7017-41e4-89e0-7db952f13268 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:02.908547 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:02.937518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c272e-8ccf-4b9b-a9ad-a766fb0d8638 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.937957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c272e-8ccf-4b9b-a9ad-a766fb0d8638 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.938337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c272e-8ccf-4b9b-a9ad-a766fb0d8638 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.940811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 358/706] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:02.946333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683375-b59d-40b1-8484-fbe17b59b9b1 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:02.946611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683375-b59d-40b1-8484-fbe17b59b9b1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:02.946887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35683375-b59d-40b1-8484-fbe17b59b9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:02.990566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-35683375-b59d-40b1-8484-fbe17b59b9b1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:02.991796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-35683375-b59d-40b1-8484-fbe17b59b9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:03.033628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa89496-7017-41e4-89e0-7db952f13268 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:03.075966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25a41-f77d-49e6-80a4-3d7686efe7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:03.077106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25a41-f77d-49e6-80a4-3d7686efe7a7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.078043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25a41-f77d-49e6-80a4-3d7686efe7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.078690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d25a41-f77d-49e6-80a4-3d7686efe7a7 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.079663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d25a41-f77d-49e6-80a4-3d7686efe7a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:03.080191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d25a41-f77d-49e6-80a4-3d7686efe7a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:03.082011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d25a41-f77d-49e6-80a4-3d7686efe7a7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:03.098004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 349/707] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:03.104196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25a41-f77d-49e6-80a4-3d7686efe7a7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:03.156284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 359/708] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:03.209768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:03.257299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d25a41-f77d-49e6-80a4-3d7686efe7a7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:03.305441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6f835-a9b5-4381-a678-ee780fb1f443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:03.306007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6f835-a9b5-4381-a678-ee780fb1f443 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.306288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6f835-a9b5-4381-a678-ee780fb1f443 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.306566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6f835-a9b5-4381-a678-ee780fb1f443 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.313525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6f835-a9b5-4381-a678-ee780fb1f443 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:03.315009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6f835-a9b5-4381-a678-ee780fb1f443 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-9be6f835-a9b5-4381-a678-ee780fb1f443 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:03.328289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:03.329199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:03.330109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:03.330109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:03.330109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:03.330109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:03.330109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:03.330109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:03.330109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:03.330109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:03.330109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 350/709] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:03.334995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683375-b59d-40b1-8484-fbe17b59b9b1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:03.476671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:03.485838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35683375-b59d-40b1-8484-fbe17b59b9b1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:03.492682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6f835-a9b5-4381-a678-ee780fb1f443 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:03.539403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8249ed01-ae1e-4f48-b1aa-81d8ea564f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:03.540022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249ed01-ae1e-4f48-b1aa-81d8ea564f4e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.540301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249ed01-ae1e-4f48-b1aa-81d8ea564f4e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.540572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8249ed01-ae1e-4f48-b1aa-81d8ea564f4e None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.541269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249ed01-ae1e-4f48-b1aa-81d8ea564f4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:03.541599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249ed01-ae1e-4f48-b1aa-81d8ea564f4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:03.543028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8249ed01-ae1e-4f48-b1aa-81d8ea564f4e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:03.571588 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 360/710] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:03.573077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b007bd-140f-4ba6-8639-1e63e915520b None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.573376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b007bd-140f-4ba6-8639-1e63e915520b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.573694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b007bd-140f-4ba6-8639-1e63e915520b None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.575241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 361/711] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:03.580194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b007bd-140f-4ba6-8639-1e63e915520b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:03.655969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6f835-a9b5-4381-a678-ee780fb1f443 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:03.690591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:03.701875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbbea98-3dcf-4b65-8057-d3b2791ddb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:03.702704 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbea98-3dcf-4b65-8057-d3b2791ddb1e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.703089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbea98-3dcf-4b65-8057-d3b2791ddb1e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.703365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbbea98-3dcf-4b65-8057-d3b2791ddb1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.703468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b007bd-140f-4ba6-8639-1e63e915520b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:03.717768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbea98-3dcf-4b65-8057-d3b2791ddb1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:03.719237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbbea98-3dcf-4b65-8057-d3b2791ddb1e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-8bbbea98-3dcf-4b65-8057-d3b2791ddb1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:03.734764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:03.735801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:03.736718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:03.736718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:03.736718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:03.740865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 351/712] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:03.742159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f6e5-68f5-4509-8ceb-eb666628518f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.742443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f6e5-68f5-4509-8ceb-eb666628518f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.742703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4f6e5-68f5-4509-8ceb-eb666628518f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.745970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67260596-e148-4f86-9a4e-9a9343467803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:03.746902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67260596-e148-4f86-9a4e-9a9343467803 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.747566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67260596-e148-4f86-9a4e-9a9343467803 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.748056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67260596-e148-4f86-9a4e-9a9343467803 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.749601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67260596-e148-4f86-9a4e-9a9343467803 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=2dbd23de9096446091fb9b7f79f047fc) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:03.750332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67260596-e148-4f86-9a4e-9a9343467803 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:03.752857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67260596-e148-4f86-9a4e-9a9343467803 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:03.759934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 362/713] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:03 2022] GET /identity/v3/role_assignments?user.id=2dbd23de9096446091fb9b7f79f047fc&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:03.761083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67260596-e148-4f86-9a4e-9a9343467803 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:03.771269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-95a4f6e5-68f5-4509-8ceb-eb666628518f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:03.772070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-95a4f6e5-68f5-4509-8ceb-eb666628518f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:03.783001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:03.893658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 352/714] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:03.912054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67260596-e148-4f86-9a4e-9a9343467803 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:03.980837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740236-31ff-4973-a30b-cf76a37d8e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:03.981523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740236-31ff-4973-a30b-cf76a37d8e8e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:03.981808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740236-31ff-4973-a30b-cf76a37d8e8e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:03.982085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3740236-31ff-4973-a30b-cf76a37d8e8e None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:03.983375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3740236-31ff-4973-a30b-cf76a37d8e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:03.983703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3740236-31ff-4973-a30b-cf76a37d8e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:03.985191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3740236-31ff-4973-a30b-cf76a37d8e8e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.005395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 363/715] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:04.011852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f6e5-68f5-4509-8ceb-eb666628518f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.141777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4f6e5-68f5-4509-8ceb-eb666628518f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.158919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:04.188407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918a70-112c-43e7-ac3f-16e0a9200d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.189020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918a70-112c-43e7-ac3f-16e0a9200d64 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.189296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918a70-112c-43e7-ac3f-16e0a9200d64 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.189596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9918a70-112c-43e7-ac3f-16e0a9200d64 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.190243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9918a70-112c-43e7-ac3f-16e0a9200d64 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.191677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9918a70-112c-43e7-ac3f-16e0a9200d64 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.222713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 353/716] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:36:04 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:04.270817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740236-31ff-4973-a30b-cf76a37d8e8e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.392054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:04.432056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3740236-31ff-4973-a30b-cf76a37d8e8e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.473995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f3d7f-e840-4131-903d-245e728e9bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.474636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f3d7f-e840-4131-903d-245e728e9bde None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.474918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f3d7f-e840-4131-903d-245e728e9bde None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.475194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f3d7f-e840-4131-903d-245e728e9bde None admin] PATH_INFO: `/v3/services/network` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.475867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f3d7f-e840-4131-903d-245e728e9bde None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.477259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f3d7f-e840-4131-903d-245e728e9bde None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-938f3d7f-e840-4131-903d-245e728e9bde None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:04.488446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:04.489486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:04.490333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 364/717] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:04.497492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918a70-112c-43e7-ac3f-16e0a9200d64 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.609889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9918a70-112c-43e7-ac3f-16e0a9200d64 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.645524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fa193-384a-41dd-bdb3-66d88e621ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.646142 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa193-384a-41dd-bdb3-66d88e621ce6 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.646417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa193-384a-41dd-bdb3-66d88e621ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.646687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fa193-384a-41dd-bdb3-66d88e621ce6 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.647317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa193-384a-41dd-bdb3-66d88e621ce6 None admin] RBAC: Adding query filter params (name=network) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:04.647615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa193-384a-41dd-bdb3-66d88e621ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.648982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235fa193-384a-41dd-bdb3-66d88e621ce6 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.653752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 354/718] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:04.659750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f3d7f-e840-4131-903d-245e728e9bde None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:04.765677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f3d7f-e840-4131-903d-245e728e9bde None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:04.801715 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e983d9-2ede-492b-8a21-aafe57fa3d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:04.802629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e983d9-2ede-492b-8a21-aafe57fa3d55 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:04.803088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e983d9-2ede-492b-8a21-aafe57fa3d55 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:04.803541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e983d9-2ede-492b-8a21-aafe57fa3d55 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:04.804374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e983d9-2ede-492b-8a21-aafe57fa3d55 None admin] RBAC: Adding query filter params (type=network) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:04.804853 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e983d9-2ede-492b-8a21-aafe57fa3d55 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:04.806431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e983d9-2ede-492b-8a21-aafe57fa3d55 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:04.812682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 365/719] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:04 2022] GET /identity/v3/services?type=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:05.155368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682af5af-592c-4038-9494-aedf1b765333 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.155937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682af5af-592c-4038-9494-aedf1b765333 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.156403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682af5af-592c-4038-9494-aedf1b765333 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.158229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 355/720] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:05.163537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572aca-845a-4077-bb2d-1e7c4c051e79 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.164367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572aca-845a-4077-bb2d-1e7c4c051e79 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.164827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13572aca-845a-4077-bb2d-1e7c4c051e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.181671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:05.187836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-13572aca-845a-4077-bb2d-1e7c4c051e79 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:05.189464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-13572aca-845a-4077-bb2d-1e7c4c051e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:05.279047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 366/721] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:05.477149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2922a4-3555-4c43-921d-b37d6cf8ad70 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.477840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2922a4-3555-4c43-921d-b37d6cf8ad70 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.478319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2922a4-3555-4c43-921d-b37d6cf8ad70 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.480130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 356/722] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:05.485253 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e044-df1c-44b7-8e66-ce12a50ca377 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.485789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e044-df1c-44b7-8e66-ce12a50ca377 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.486308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84e044-df1c-44b7-8e66-ce12a50ca377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.510391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-5d84e044-df1c-44b7-8e66-ce12a50ca377 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:05.511940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5d84e044-df1c-44b7-8e66-ce12a50ca377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:05.601514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 367/723] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:05.618445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2922a4-3555-4c43-921d-b37d6cf8ad70 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:05.673931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:05.893916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2922a4-3555-4c43-921d-b37d6cf8ad70 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:05.930583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e044-df1c-44b7-8e66-ce12a50ca377 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:05.944346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f7334-174c-4c09-bdd1-985d1c76b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:05.944982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f7334-174c-4c09-bdd1-985d1c76b3f8 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:05.945259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f7334-174c-4c09-bdd1-985d1c76b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:05.945693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f7334-174c-4c09-bdd1-985d1c76b3f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:05.965189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817f7334-174c-4c09-bdd1-985d1c76b3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-817f7334-174c-4c09-bdd1-985d1c76b3f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:05.970781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:05.971724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:05.972558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 357/724] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:05.978537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f7334-174c-4c09-bdd1-985d1c76b3f8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:06.049987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:06.129886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:06.135569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84e044-df1c-44b7-8e66-ce12a50ca377 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.144331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817f7334-174c-4c09-bdd1-985d1c76b3f8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.190012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f0c97-0611-4fe4-aa76-ae56605cbb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.190946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0c97-0611-4fe4-aa76-ae56605cbb9c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.191442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0c97-0611-4fe4-aa76-ae56605cbb9c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.191911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9f0c97-0611-4fe4-aa76-ae56605cbb9c None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.192773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f0c97-0611-4fe4-aa76-ae56605cbb9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:06.194652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f0c97-0611-4fe4-aa76-ae56605cbb9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.196347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9f0c97-0611-4fe4-aa76-ae56605cbb9c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:06.215819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 358/725] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:06.225276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13dc38-33f0-45bb-b197-1fd5531a7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.225934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13dc38-33f0-45bb-b197-1fd5531a7a33 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.226212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13dc38-33f0-45bb-b197-1fd5531a7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.226486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d13dc38-33f0-45bb-b197-1fd5531a7a33 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.227152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13dc38-33f0-45bb-b197-1fd5531a7a33 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.228509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d13dc38-33f0-45bb-b197-1fd5531a7a33 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:06.238809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f0c97-0611-4fe4-aa76-ae56605cbb9c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:06.259168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 368/726] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:05 2022] POST /identity/v3/services => generated 251 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:06.384507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9f0c97-0611-4fe4-aa76-ae56605cbb9c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.454352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccfad4e-0209-4c79-82da-f76d7a6fffb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.454922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfad4e-0209-4c79-82da-f76d7a6fffb9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.455206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfad4e-0209-4c79-82da-f76d7a6fffb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.455487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccfad4e-0209-4c79-82da-f76d7a6fffb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.469632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfad4e-0209-4c79-82da-f76d7a6fffb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.471117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccfad4e-0209-4c79-82da-f76d7a6fffb9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:06.480413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-cccfad4e-0209-4c79-82da-f76d7a6fffb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:06.489210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:06.490241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:06.491558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:06.491558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:06.491558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:06.491558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 359/727] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:06.498487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13dc38-33f0-45bb-b197-1fd5531a7a33 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:06.560507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed33af-384a-46e6-aa09-773a18b10a61 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.561232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed33af-384a-46e6-aa09-773a18b10a61 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.561768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fed33af-384a-46e6-aa09-773a18b10a61 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.563611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 360/728] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:06.569062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1af93-3136-40af-8120-35168b6b7532 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.569669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1af93-3136-40af-8120-35168b6b7532 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.570180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f1af93-3136-40af-8120-35168b6b7532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.590941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-98f1af93-3136-40af-8120-35168b6b7532 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:06.593080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-98f1af93-3136-40af-8120-35168b6b7532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:06.638713 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d13dc38-33f0-45bb-b197-1fd5531a7a33 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.669389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:06.681530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607354d-38c3-4d58-9599-6ae7118687c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.682432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607354d-38c3-4d58-9599-6ae7118687c3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.689435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 361/729] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:06 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 17 00:36:06.689873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607354d-38c3-4d58-9599-6ae7118687c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.690073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607354d-38c3-4d58-9599-6ae7118687c3 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.690751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607354d-38c3-4d58-9599-6ae7118687c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:06.691058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607354d-38c3-4d58-9599-6ae7118687c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.692506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607354d-38c3-4d58-9599-6ae7118687c3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:06.705613 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 369/730] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:06.711253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1af93-3136-40af-8120-35168b6b7532 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:06.825231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f1af93-3136-40af-8120-35168b6b7532 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:06.872930 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:06.882982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759d6a2-f6e6-4b59-b509-c7ecc85d3821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:06.884180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759d6a2-f6e6-4b59-b509-c7ecc85d3821 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:06.884881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759d6a2-f6e6-4b59-b509-c7ecc85d3821 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:06.885447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759d6a2-f6e6-4b59-b509-c7ecc85d3821 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:06.898464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759d6a2-f6e6-4b59-b509-c7ecc85d3821 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:06.900285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759d6a2-f6e6-4b59-b509-c7ecc85d3821 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-7759d6a2-f6e6-4b59-b509-c7ecc85d3821 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:06.915029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:06.916024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:06.917361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 362/731] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:06 2022] GET /identity/v3/users/swift => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:06.924100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607354d-38c3-4d58-9599-6ae7118687c3 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.025314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759d6a2-f6e6-4b59-b509-c7ecc85d3821 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.066190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607354d-38c3-4d58-9599-6ae7118687c3 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.127729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92efae-8a4f-4d1a-935e-7e69cba9e831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.128743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92efae-8a4f-4d1a-935e-7e69cba9e831 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.129334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92efae-8a4f-4d1a-935e-7e69cba9e831 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.130575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92efae-8a4f-4d1a-935e-7e69cba9e831 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.131624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92efae-8a4f-4d1a-935e-7e69cba9e831 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:07.132270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92efae-8a4f-4d1a-935e-7e69cba9e831 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:07.135025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92efae-8a4f-4d1a-935e-7e69cba9e831 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.165557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 370/732] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 17 00:36:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:07.167583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92efae-8a4f-4d1a-935e-7e69cba9e831 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.231975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759d6a2-f6e6-4b59-b509-c7ecc85d3821 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.245834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:07.268723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e767eb0-8cb3-42ba-baaa-0ac0f6407bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.269353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e767eb0-8cb3-42ba-baaa-0ac0f6407bee None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.269661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e767eb0-8cb3-42ba-baaa-0ac0f6407bee None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.269934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e767eb0-8cb3-42ba-baaa-0ac0f6407bee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.281125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e767eb0-8cb3-42ba-baaa-0ac0f6407bee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-5e767eb0-8cb3-42ba-baaa-0ac0f6407bee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:07.286728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:07.287646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:07.289092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 363/733] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:07.289836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad52c-f598-4c69-8672-bdab28007a50 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.289836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad52c-f598-4c69-8672-bdab28007a50 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.289959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cad52c-f598-4c69-8672-bdab28007a50 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.291360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 364/734] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:07.293832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad52c-f598-4c69-8672-bdab28007a50 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.303762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92efae-8a4f-4d1a-935e-7e69cba9e831 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.340074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6921a60-cd45-4189-894d-f5c1c9aae0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.340989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6921a60-cd45-4189-894d-f5c1c9aae0da None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.341609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6921a60-cd45-4189-894d-f5c1c9aae0da None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.342168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6921a60-cd45-4189-894d-f5c1c9aae0da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.348703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:07.405351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cad52c-f598-4c69-8672-bdab28007a50 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.425800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6921a60-cd45-4189-894d-f5c1c9aae0da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:07.427695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6921a60-cd45-4189-894d-f5c1c9aae0da None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.454150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2e55c7-8e2c-4389-a7a2-c3db3c0b6cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.454760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e55c7-8e2c-4389-a7a2-c3db3c0b6cfc None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.455037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e55c7-8e2c-4389-a7a2-c3db3c0b6cfc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.455309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2e55c7-8e2c-4389-a7a2-c3db3c0b6cfc None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.455976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e55c7-8e2c-4389-a7a2-c3db3c0b6cfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:07.456375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e55c7-8e2c-4389-a7a2-c3db3c0b6cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:07.457958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2e55c7-8e2c-4389-a7a2-c3db3c0b6cfc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.472313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 365/735] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:07.472313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cd596-b2be-4384-93fd-c47d665e80e7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.472313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cd596-b2be-4384-93fd-c47d665e80e7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.472313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8cd596-b2be-4384-93fd-c47d665e80e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.484716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:07.490557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-1f8cd596-b2be-4384-93fd-c47d665e80e7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:07.491756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1f8cd596-b2be-4384-93fd-c47d665e80e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:07.544741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 371/736] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 17 00:36:07.546006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6921a60-cd45-4189-894d-f5c1c9aae0da None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.571118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 366/737] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:07.572358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86163b96-33f4-458b-bcfb-dab796f8b170 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.572641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86163b96-33f4-458b-bcfb-dab796f8b170 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.572914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86163b96-33f4-458b-bcfb-dab796f8b170 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.574404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 367/738] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:07.575102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86163b96-33f4-458b-bcfb-dab796f8b170 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.659506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6921a60-cd45-4189-894d-f5c1c9aae0da None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.665829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:07.690005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86163b96-33f4-458b-bcfb-dab796f8b170 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.700339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c78b9-d58e-4a57-ade2-3d7d0fa9365d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.701701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c78b9-d58e-4a57-ade2-3d7d0fa9365d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.702438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c78b9-d58e-4a57-ade2-3d7d0fa9365d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.702928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c78b9-d58e-4a57-ade2-3d7d0fa9365d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.714728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c78b9-d58e-4a57-ade2-3d7d0fa9365d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:07.716567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c78b9-d58e-4a57-ade2-3d7d0fa9365d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.720355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:07.728036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9bed-8e36-4f70-81c0-fdaa6b95cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.728839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9bed-8e36-4f70-81c0-fdaa6b95cada None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.729260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9bed-8e36-4f70-81c0-fdaa6b95cada None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.729719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d9bed-8e36-4f70-81c0-fdaa6b95cada None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-cd0c78b9-d58e-4a57-ade2-3d7d0fa9365d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:07.734278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:07.735381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:07.736489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:07.736489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:07.736489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:07.741531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 372/739] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:07.744303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d536a5c-8adb-4bca-8ed9-50ee6246d9d5 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.744580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d536a5c-8adb-4bca-8ed9-50ee6246d9d5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.744848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d536a5c-8adb-4bca-8ed9-50ee6246d9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.747402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d9bed-8e36-4f70-81c0-fdaa6b95cada None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:07.749677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d9bed-8e36-4f70-81c0-fdaa6b95cada None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.762927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3d536a5c-8adb-4bca-8ed9-50ee6246d9d5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:07.764682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3d536a5c-8adb-4bca-8ed9-50ee6246d9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-952d9bed-8e36-4f70-81c0-fdaa6b95cada None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:07.769829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:07.770754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:07.771686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:07.771686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:07.771686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:07.774145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 368/740] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:07.775472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9bed-8e36-4f70-81c0-fdaa6b95cada None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.841601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 373/741] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:07 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 17 00:36:07.842456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d536a5c-8adb-4bca-8ed9-50ee6246d9d5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:07.888409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:07.897331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d9bed-8e36-4f70-81c0-fdaa6b95cada None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:07.937866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672067c8-d508-452a-896a-03afeedfeb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:07.939015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672067c8-d508-452a-896a-03afeedfeb50 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:07.939302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672067c8-d508-452a-896a-03afeedfeb50 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:07.939633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672067c8-d508-452a-896a-03afeedfeb50 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:07.940335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672067c8-d508-452a-896a-03afeedfeb50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:07.940813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672067c8-d508-452a-896a-03afeedfeb50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:07.942576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672067c8-d508-452a-896a-03afeedfeb50 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:07.959298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 369/742] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:07.960042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672067c8-d508-452a-896a-03afeedfeb50 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.002554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d536a5c-8adb-4bca-8ed9-50ee6246d9d5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.034846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.048366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1d084-0cdf-4358-98d3-5eed91af7751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.048982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1d084-0cdf-4358-98d3-5eed91af7751 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.049266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1d084-0cdf-4358-98d3-5eed91af7751 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.049575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b1d084-0cdf-4358-98d3-5eed91af7751 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.050394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1d084-0cdf-4358-98d3-5eed91af7751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:08.050706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1d084-0cdf-4358-98d3-5eed91af7751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.052621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b1d084-0cdf-4358-98d3-5eed91af7751 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.069370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 374/743] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:08.069370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1d084-0cdf-4358-98d3-5eed91af7751 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.100047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672067c8-d508-452a-896a-03afeedfeb50 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.144007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbce262-8191-4cea-bdd6-d8b795c2db44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.144641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbce262-8191-4cea-bdd6-d8b795c2db44 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.144926 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbce262-8191-4cea-bdd6-d8b795c2db44 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.145197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbce262-8191-4cea-bdd6-d8b795c2db44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.156133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbce262-8191-4cea-bdd6-d8b795c2db44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-fcbce262-8191-4cea-bdd6-d8b795c2db44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:08.160911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:08.162053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:08.162904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 370/744] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:36:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:08.163593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbce262-8191-4cea-bdd6-d8b795c2db44 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.180544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.186866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b1d084-0cdf-4358-98d3-5eed91af7751 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.222737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9e272-bb8f-4a9e-8120-691705c6827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.223382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9e272-bb8f-4a9e-8120-691705c6827e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.223693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9e272-bb8f-4a9e-8120-691705c6827e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.223937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9e272-bb8f-4a9e-8120-691705c6827e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.232468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9e272-bb8f-4a9e-8120-691705c6827e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.234630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b9e272-bb8f-4a9e-8120-691705c6827e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-33b9e272-bb8f-4a9e-8120-691705c6827e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:08.250236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:08.251670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:08.252856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:08.256202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 375/745] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:08.256749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9e272-bb8f-4a9e-8120-691705c6827e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.277797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbce262-8191-4cea-bdd6-d8b795c2db44 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.309061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.313639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9b13d-dfc5-42b2-9d5c-d389d53843cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.314272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9b13d-dfc5-42b2-9d5c-d389d53843cf None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.314547 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9b13d-dfc5-42b2-9d5c-d389d53843cf None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.314819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9b13d-dfc5-42b2-9d5c-d389d53843cf None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.322431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9b13d-dfc5-42b2-9d5c-d389d53843cf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.323992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d9b13d-dfc5-42b2-9d5c-d389d53843cf None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-74d9b13d-dfc5-42b2-9d5c-d389d53843cf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:08.335038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:08.336020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 371/746] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:08.336889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9b13d-dfc5-42b2-9d5c-d389d53843cf None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.374745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b9e272-bb8f-4a9e-8120-691705c6827e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.411870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598218-e275-44f2-9125-ee6715a0ea1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.415297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598218-e275-44f2-9125-ee6715a0ea1a None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.415297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598218-e275-44f2-9125-ee6715a0ea1a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.415297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39598218-e275-44f2-9125-ee6715a0ea1a None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.415297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598218-e275-44f2-9125-ee6715a0ea1a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.415618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39598218-e275-44f2-9125-ee6715a0ea1a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.416649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.433798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 376/747] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:08 2022] POST /identity/v3/services => generated 240 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:08.435009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598218-e275-44f2-9125-ee6715a0ea1a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.447653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d9b13d-dfc5-42b2-9d5c-d389d53843cf None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.497516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf4928-cf6f-44c9-a8cc-63b45fa82bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.498537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf4928-cf6f-44c9-a8cc-63b45fa82bdb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.498968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf4928-cf6f-44c9-a8cc-63b45fa82bdb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.499651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf4928-cf6f-44c9-a8cc-63b45fa82bdb None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.500568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf4928-cf6f-44c9-a8cc-63b45fa82bdb None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:08.501030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf4928-cf6f-44c9-a8cc-63b45fa82bdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.502782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbf4928-cf6f-44c9-a8cc-63b45fa82bdb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.520182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 372/748] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:08.521385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf4928-cf6f-44c9-a8cc-63b45fa82bdb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.581062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39598218-e275-44f2-9125-ee6715a0ea1a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.589825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.630479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a14da-0692-45f0-8455-1490426ca703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.630752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a14da-0692-45f0-8455-1490426ca703 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.630986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a14da-0692-45f0-8455-1490426ca703 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.631258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a14da-0692-45f0-8455-1490426ca703 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.632040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a14da-0692-45f0-8455-1490426ca703 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:08.632345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a14da-0692-45f0-8455-1490426ca703 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.633947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a14da-0692-45f0-8455-1490426ca703 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.657328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 377/749] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:08.658382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a14da-0692-45f0-8455-1490426ca703 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.668231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbf4928-cf6f-44c9-a8cc-63b45fa82bdb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.705174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.718813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682080-0a1c-4fc0-9bb3-d29d99c802f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.720023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682080-0a1c-4fc0-9bb3-d29d99c802f1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.720898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682080-0a1c-4fc0-9bb3-d29d99c802f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.721375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f682080-0a1c-4fc0-9bb3-d29d99c802f1 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.722363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f682080-0a1c-4fc0-9bb3-d29d99c802f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:08.722869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f682080-0a1c-4fc0-9bb3-d29d99c802f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.725350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f682080-0a1c-4fc0-9bb3-d29d99c802f1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.743639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 373/750] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:08.744872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682080-0a1c-4fc0-9bb3-d29d99c802f1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.773540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a14da-0692-45f0-8455-1490426ca703 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.822322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add25b-4edc-482e-b57c-d1bf6b1d7bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.824084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add25b-4edc-482e-b57c-d1bf6b1d7bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.824679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add25b-4edc-482e-b57c-d1bf6b1d7bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.825108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85add25b-4edc-482e-b57c-d1bf6b1d7bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.841297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85add25b-4edc-482e-b57c-d1bf6b1d7bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.843646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85add25b-4edc-482e-b57c-d1bf6b1d7bd5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-85add25b-4edc-482e-b57c-d1bf6b1d7bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:08.861889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:08.863080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:08.864185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:08.864185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:08.864185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:08.865570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 378/751] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:08.866541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add25b-4edc-482e-b57c-d1bf6b1d7bd5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.879654 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f682080-0a1c-4fc0-9bb3-d29d99c802f1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:08.886882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:08.923620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408ef90-90b4-4e7c-8179-0b3123721969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:08.924514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ef90-90b4-4e7c-8179-0b3123721969 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:08.924944 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ef90-90b4-4e7c-8179-0b3123721969 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:08.925397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408ef90-90b4-4e7c-8179-0b3123721969 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:08.939536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408ef90-90b4-4e7c-8179-0b3123721969 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:08.940993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408ef90-90b4-4e7c-8179-0b3123721969 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-7408ef90-90b4-4e7c-8179-0b3123721969 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:08.955025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:08.956008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:08.956914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:08.956914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:08.956914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:08.956914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 374/752] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:08.956914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408ef90-90b4-4e7c-8179-0b3123721969 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:08.984167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85add25b-4edc-482e-b57c-d1bf6b1d7bd5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.005043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.022111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637671-22f6-41c8-ad11-26b40e5fc68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.022744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637671-22f6-41c8-ad11-26b40e5fc68f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.023033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637671-22f6-41c8-ad11-26b40e5fc68f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.023538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637671-22f6-41c8-ad11-26b40e5fc68f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.024027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12637671-22f6-41c8-ad11-26b40e5fc68f None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=6247f16e4bf6497183e40a7ed31ff23c) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:09.024409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12637671-22f6-41c8-ad11-26b40e5fc68f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.025778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12637671-22f6-41c8-ad11-26b40e5fc68f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.031297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 379/753] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/role_assignments?user.id=6247f16e4bf6497183e40a7ed31ff23c&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:09.032678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e883bf-b5d8-4745-b324-9d35132efcf5 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.032797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e883bf-b5d8-4745-b324-9d35132efcf5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.033023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e883bf-b5d8-4745-b324-9d35132efcf5 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.038828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 380/754] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:09.039638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e883bf-b5d8-4745-b324-9d35132efcf5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.068365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408ef90-90b4-4e7c-8179-0b3123721969 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.113254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee16a7-3e83-41da-9664-3f151b34b3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.114298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee16a7-3e83-41da-9664-3f151b34b3f4 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.114787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee16a7-3e83-41da-9664-3f151b34b3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.115296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee16a7-3e83-41da-9664-3f151b34b3f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.116286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee16a7-3e83-41da-9664-3f151b34b3f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:09.117263 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee16a7-3e83-41da-9664-3f151b34b3f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.120117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ee16a7-3e83-41da-9664-3f151b34b3f4 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.134749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.136286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 375/755] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:09.138297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc08f-3b87-4ee0-9720-6c16cb25215f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.139447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc08f-3b87-4ee0-9720-6c16cb25215f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.139952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fbc08f-3b87-4ee0-9720-6c16cb25215f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.162082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-72fbc08f-3b87-4ee0-9720-6c16cb25215f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:09.163870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-72fbc08f-3b87-4ee0-9720-6c16cb25215f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:09.167307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e883bf-b5d8-4745-b324-9d35132efcf5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.209221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f31da0-cebe-4c35-8a02-a8eb62e246f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.209896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f31da0-cebe-4c35-8a02-a8eb62e246f1 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.210188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f31da0-cebe-4c35-8a02-a8eb62e246f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.210454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f31da0-cebe-4c35-8a02-a8eb62e246f1 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.211230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f31da0-cebe-4c35-8a02-a8eb62e246f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:09.211538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f31da0-cebe-4c35-8a02-a8eb62e246f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.213092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f31da0-cebe-4c35-8a02-a8eb62e246f1 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.233487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 381/756] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:09.233487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f31da0-cebe-4c35-8a02-a8eb62e246f1 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.258492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 376/757] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:09.259655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbc08f-3b87-4ee0-9720-6c16cb25215f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.341939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.384615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f31da0-cebe-4c35-8a02-a8eb62e246f1 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.452086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ff256-a9c2-459b-8c26-b3df184213d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.452723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ff256-a9c2-459b-8c26-b3df184213d6 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.452998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ff256-a9c2-459b-8c26-b3df184213d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.453268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ff256-a9c2-459b-8c26-b3df184213d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.455593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fbc08f-3b87-4ee0-9720-6c16cb25215f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.469743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ff256-a9c2-459b-8c26-b3df184213d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.471193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ff256-a9c2-459b-8c26-b3df184213d6 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.476694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-489ff256-a9c2-459b-8c26-b3df184213d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:09.493709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:09.494745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:09.496101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 382/758] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:09.500865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ff256-a9c2-459b-8c26-b3df184213d6 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.536033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eca43-f159-4f31-8578-10443fbaf322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.536685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eca43-f159-4f31-8578-10443fbaf322 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.536961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eca43-f159-4f31-8578-10443fbaf322 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.537231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5eca43-f159-4f31-8578-10443fbaf322 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.550199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5eca43-f159-4f31-8578-10443fbaf322 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.553893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5eca43-f159-4f31-8578-10443fbaf322 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-ba5eca43-f159-4f31-8578-10443fbaf322 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:09.578565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:09.579513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:09.580389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:09.580389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:09.580389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:09.580389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:09.580389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:09.580389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:09.580389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:09.580389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:09.581344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 377/759] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:09.587450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eca43-f159-4f31-8578-10443fbaf322 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.644815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ff256-a9c2-459b-8c26-b3df184213d6 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.683003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ff4f-dcd8-4bc5-968f-8393cd6e4e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.683548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ff4f-dcd8-4bc5-968f-8393cd6e4e60 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.683831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ff4f-dcd8-4bc5-968f-8393cd6e4e60 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.684109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f3ff4f-dcd8-4bc5-968f-8393cd6e4e60 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.684844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3ff4f-dcd8-4bc5-968f-8393cd6e4e60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:09.686256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3ff4f-dcd8-4bc5-968f-8393cd6e4e60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.688002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f3ff4f-dcd8-4bc5-968f-8393cd6e4e60 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.692077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.700239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5eca43-f159-4f31-8578-10443fbaf322 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.712832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 383/760] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:09.714146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ff4f-dcd8-4bc5-968f-8393cd6e4e60 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.742389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe63e3-813e-446c-9b53-a72a526aaeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.743107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe63e3-813e-446c-9b53-a72a526aaeaf None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.743390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe63e3-813e-446c-9b53-a72a526aaeaf None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.743682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe63e3-813e-446c-9b53-a72a526aaeaf None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.744444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe63e3-813e-446c-9b53-a72a526aaeaf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:09.744751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe63e3-813e-446c-9b53-a72a526aaeaf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.746317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe63e3-813e-446c-9b53-a72a526aaeaf None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.759192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 378/761] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:09.760031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe63e3-813e-446c-9b53-a72a526aaeaf None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.784956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:09.833441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f3ff4f-dcd8-4bc5-968f-8393cd6e4e60 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.876109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb08a2-157e-4234-a50c-266509ba127a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.876744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb08a2-157e-4234-a50c-266509ba127a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.877027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb08a2-157e-4234-a50c-266509ba127a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.877303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fb08a2-157e-4234-a50c-266509ba127a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.877926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb08a2-157e-4234-a50c-266509ba127a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:09.878183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe63e3-813e-446c-9b53-a72a526aaeaf None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:09.879337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fb08a2-157e-4234-a50c-266509ba127a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-48fb08a2-157e-4234-a50c-266509ba127a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:09.891415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:09.892482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:09.893939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 384/762] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:09.894728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb08a2-157e-4234-a50c-266509ba127a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:09.920554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ab3fc-1900-4f95-8241-5a949b038051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:09.921835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ab3fc-1900-4f95-8241-5a949b038051 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:09.922348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ab3fc-1900-4f95-8241-5a949b038051 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:09.922825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5ab3fc-1900-4f95-8241-5a949b038051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:09.952407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.003742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ab3fc-1900-4f95-8241-5a949b038051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.005715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5ab3fc-1900-4f95-8241-5a949b038051 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.010362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fb08a2-157e-4234-a50c-266509ba127a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.040887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.055263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e92e-1c72-480b-8c61-d655c648b58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.056054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e92e-1c72-480b-8c61-d655c648b58f None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.056300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e92e-1c72-480b-8c61-d655c648b58f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.056582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e92e-1c72-480b-8c61-d655c648b58f None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/2dbd23de9096446091fb9b7f79f047fc/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.058591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e92e-1c72-480b-8c61-d655c648b58f None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=2dbd23de9096446091fb9b7f79f047fc, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.061343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e92e-1c72-480b-8c61-d655c648b58f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.085442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 385/763] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:09 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/2dbd23de9096446091fb9b7f79f047fc/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:10.085442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e92e-1c72-480b-8c61-d655c648b58f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.160274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 379/764] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:09 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:10.166057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ab3fc-1900-4f95-8241-5a949b038051 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.207062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e92e-1c72-480b-8c61-d655c648b58f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.250539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef4873-ad8b-4de7-aba9-3ea0c559e403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.251160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef4873-ad8b-4de7-aba9-3ea0c559e403 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.251442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef4873-ad8b-4de7-aba9-3ea0c559e403 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.251726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ef4873-ad8b-4de7-aba9-3ea0c559e403 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.255453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef4873-ad8b-4de7-aba9-3ea0c559e403 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:10.255453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef4873-ad8b-4de7-aba9-3ea0c559e403 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.255453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ef4873-ad8b-4de7-aba9-3ea0c559e403 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.260537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 386/765] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.268423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef4873-ad8b-4de7-aba9-3ea0c559e403 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.286533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.342441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5ab3fc-1900-4f95-8241-5a949b038051 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.379202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.383383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739718f-bc0c-4cf8-ad1d-33e95b5c61aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.384241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739718f-bc0c-4cf8-ad1d-33e95b5c61aa None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.384670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739718f-bc0c-4cf8-ad1d-33e95b5c61aa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.385095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739718f-bc0c-4cf8-ad1d-33e95b5c61aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.396841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739718f-bc0c-4cf8-ad1d-33e95b5c61aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.398641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1739718f-bc0c-4cf8-ad1d-33e95b5c61aa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-1739718f-bc0c-4cf8-ad1d-33e95b5c61aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:10.417830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:10.418963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:10.420069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:10.420069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:10.420069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:10.422170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 380/766] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:10.428049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739718f-bc0c-4cf8-ad1d-33e95b5c61aa None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.448819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ef4873-ad8b-4de7-aba9-3ea0c559e403 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.491368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da931-ca51-41e3-86b0-67c51562113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.492268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da931-ca51-41e3-86b0-67c51562113f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.492749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da931-ca51-41e3-86b0-67c51562113f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.493203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2da931-ca51-41e3-86b0-67c51562113f None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.494209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2da931-ca51-41e3-86b0-67c51562113f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:10.494698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2da931-ca51-41e3-86b0-67c51562113f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.496855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2da931-ca51-41e3-86b0-67c51562113f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.503728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 387/767] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.508545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da931-ca51-41e3-86b0-67c51562113f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.540935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1739718f-bc0c-4cf8-ad1d-33e95b5c61aa None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.548892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.617655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069b78d-f602-4100-b916-1a2000f02ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.618391 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069b78d-f602-4100-b916-1a2000f02ccd None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.618747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069b78d-f602-4100-b916-1a2000f02ccd None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.619108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069b78d-f602-4100-b916-1a2000f02ccd None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.619822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069b78d-f602-4100-b916-1a2000f02ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:10.620204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069b78d-f602-4100-b916-1a2000f02ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.621758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069b78d-f602-4100-b916-1a2000f02ccd None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.626657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2da931-ca51-41e3-86b0-67c51562113f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.638171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.645333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 381/768] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.651085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069b78d-f602-4100-b916-1a2000f02ccd None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.666565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59043d8c-61ac-4335-a6d4-e0320c40fcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.667553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59043d8c-61ac-4335-a6d4-e0320c40fcee None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.668020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59043d8c-61ac-4335-a6d4-e0320c40fcee None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.668478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59043d8c-61ac-4335-a6d4-e0320c40fcee None admin] PATH_INFO: `/v3/endpoints` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.669860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59043d8c-61ac-4335-a6d4-e0320c40fcee None admin] RBAC: Adding query filter params (interface=public, service_id=612ac9e1732a4e7884608154c3ecf2e2, region_id=RegionOne) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:10.670424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59043d8c-61ac-4335-a6d4-e0320c40fcee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.672422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59043d8c-61ac-4335-a6d4-e0320c40fcee None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.690613 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 388/769] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/endpoints?service_id=612ac9e1732a4e7884608154c3ecf2e2&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.695433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59043d8c-61ac-4335-a6d4-e0320c40fcee None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.839936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069b78d-f602-4100-b916-1a2000f02ccd None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.878452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59043d8c-61ac-4335-a6d4-e0320c40fcee None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:10.890014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e68f334-8817-4b5e-9b0d-38251ce177fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.890651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68f334-8817-4b5e-9b0d-38251ce177fa None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.890929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68f334-8817-4b5e-9b0d-38251ce177fa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.891202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e68f334-8817-4b5e-9b0d-38251ce177fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.898073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68f334-8817-4b5e-9b0d-38251ce177fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.899516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e68f334-8817-4b5e-9b0d-38251ce177fa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-5e68f334-8817-4b5e-9b0d-38251ce177fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:10.911566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:10.912462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:10.913997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:10.913997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:10.913997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:10.913997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:10.913997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:10.913997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:10.913997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:10.913997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:10.913997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 382/770] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:10.914653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396085cf-899b-4bdd-92f4-c85593cb27f3 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.917374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396085cf-899b-4bdd-92f4-c85593cb27f3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.917374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396085cf-899b-4bdd-92f4-c85593cb27f3 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.921254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 383/771] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:10.922056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396085cf-899b-4bdd-92f4-c85593cb27f3 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:10.922171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834b0b5d-5510-41e8-8a0b-65b6db53ab97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:10.922763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b0b5d-5510-41e8-8a0b-65b6db53ab97 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.923046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b0b5d-5510-41e8-8a0b-65b6db53ab97 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.923323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834b0b5d-5510-41e8-8a0b-65b6db53ab97 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.923941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b0b5d-5510-41e8-8a0b-65b6db53ab97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:10.926645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834b0b5d-5510-41e8-8a0b-65b6db53ab97 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:10.932914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 389/772] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/services => generated 772 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:10.934736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b669-ee0d-4007-9264-c33dee4d2f35 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:10.935028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b669-ee0d-4007-9264-c33dee4d2f35 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:10.935308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21b669-ee0d-4007-9264-c33dee4d2f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:10.956938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7b21b669-ee0d-4007-9264-c33dee4d2f35 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:10.958208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7b21b669-ee0d-4007-9264-c33dee4d2f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:10.978592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:10.999082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.046500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 390/773] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:11.140883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396085cf-899b-4bdd-92f4-c85593cb27f3 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.186546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41e174-a0e4-449e-b919-36d63c143bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.187162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41e174-a0e4-449e-b919-36d63c143bd7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.187444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41e174-a0e4-449e-b919-36d63c143bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.187720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab41e174-a0e4-449e-b919-36d63c143bd7 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.188418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41e174-a0e4-449e-b919-36d63c143bd7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:11.188722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41e174-a0e4-449e-b919-36d63c143bd7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.190196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab41e174-a0e4-449e-b919-36d63c143bd7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.203036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 384/774] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:11.208494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b669-ee0d-4007-9264-c33dee4d2f35 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.321800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21b669-ee0d-4007-9264-c33dee4d2f35 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.360809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b85f70c-9dc0-4c25-be53-dc4055394b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.361832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85f70c-9dc0-4c25-be53-dc4055394b32 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.362338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85f70c-9dc0-4c25-be53-dc4055394b32 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.362837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b85f70c-9dc0-4c25-be53-dc4055394b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.363771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85f70c-9dc0-4c25-be53-dc4055394b32 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=e639d502dd3c46199da050a0f71de561) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:11.364282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85f70c-9dc0-4c25-be53-dc4055394b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.365985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b85f70c-9dc0-4c25-be53-dc4055394b32 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.372224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 391/775] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/role_assignments?user.id=e639d502dd3c46199da050a0f71de561&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:11.449958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41e174-a0e4-449e-b919-36d63c143bd7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.451434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cd21-da75-4edc-bc79-5d408589bded None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.451872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cd21-da75-4edc-bc79-5d408589bded None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.452058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8cd21-da75-4edc-bc79-5d408589bded None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.453684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 392/776] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:11.459243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f12761-cfce-4190-87cc-85ed73d3385d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.459546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f12761-cfce-4190-87cc-85ed73d3385d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.459808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f12761-cfce-4190-87cc-85ed73d3385d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.481469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-10f12761-cfce-4190-87cc-85ed73d3385d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:11.481469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-10f12761-cfce-4190-87cc-85ed73d3385d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:11.515581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.579698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 393/777] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:11.613342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:11.630423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab41e174-a0e4-449e-b919-36d63c143bd7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.674316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d4041-6528-4905-9c09-6df3a9d31eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.674879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d4041-6528-4905-9c09-6df3a9d31eb3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.675159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d4041-6528-4905-9c09-6df3a9d31eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.675434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672d4041-6528-4905-9c09-6df3a9d31eb3 None admin] PATH_INFO: `/v3/services/network` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.676023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d4041-6528-4905-9c09-6df3a9d31eb3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.677552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672d4041-6528-4905-9c09-6df3a9d31eb3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-672d4041-6528-4905-9c09-6df3a9d31eb3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:11.687253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:11.688241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:11.689092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 385/778] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/services/network => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:11.694518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f12761-cfce-4190-87cc-85ed73d3385d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:11.843568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f12761-cfce-4190-87cc-85ed73d3385d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:11.878190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcaf1a-32f8-4897-b579-83346aad3cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:11.878805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcaf1a-32f8-4897-b579-83346aad3cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:11.879089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcaf1a-32f8-4897-b579-83346aad3cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:11.879367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffcaf1a-32f8-4897-b579-83346aad3cd4 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:11.880009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcaf1a-32f8-4897-b579-83346aad3cd4 None admin] RBAC: Adding query filter params (name=network) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:11.880314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcaf1a-32f8-4897-b579-83346aad3cd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:11.881783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffcaf1a-32f8-4897-b579-83346aad3cd4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:11.886767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 394/779] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:11.893016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d4041-6528-4905-9c09-6df3a9d31eb3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.015768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672d4041-6528-4905-9c09-6df3a9d31eb3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.034131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcaf1a-32f8-4897-b579-83346aad3cd4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.063595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10762bf3-8a9f-4446-91be-d6032eb8ccc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.064565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10762bf3-8a9f-4446-91be-d6032eb8ccc6 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.065201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.065617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10762bf3-8a9f-4446-91be-d6032eb8ccc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.066741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10762bf3-8a9f-4446-91be-d6032eb8ccc6 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.067877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10762bf3-8a9f-4446-91be-d6032eb8ccc6 None admin] RBAC: Adding query filter params (type=network) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.068415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10762bf3-8a9f-4446-91be-d6032eb8ccc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.074928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10762bf3-8a9f-4446-91be-d6032eb8ccc6 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.082473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 386/780] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:12.090896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10762bf3-8a9f-4446-91be-d6032eb8ccc6 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.110104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.190399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffcaf1a-32f8-4897-b579-83346aad3cd4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.227684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243cf03-12e9-4222-a126-142ddea82c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.228426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243cf03-12e9-4222-a126-142ddea82c58 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.228784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243cf03-12e9-4222-a126-142ddea82c58 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.229135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6243cf03-12e9-4222-a126-142ddea82c58 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.239525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6243cf03-12e9-4222-a126-142ddea82c58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-6243cf03-12e9-4222-a126-142ddea82c58 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:12.247079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:12.248515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:12.249423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:12.254992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 395/781] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:12.259129 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243cf03-12e9-4222-a126-142ddea82c58 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.289114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10762bf3-8a9f-4446-91be-d6032eb8ccc6 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.351532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a66b6a-2e1b-4ea2-b523-3452431771ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.352571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a66b6a-2e1b-4ea2-b523-3452431771ab None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.354245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a66b6a-2e1b-4ea2-b523-3452431771ab None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.355303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a66b6a-2e1b-4ea2-b523-3452431771ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.356973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a66b6a-2e1b-4ea2-b523-3452431771ab None admin] RBAC: Adding query filter params (interface=public, service_id=787ec546f9414ba49104d46b9d90f64a, region_id=RegionOne) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.358137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a66b6a-2e1b-4ea2-b523-3452431771ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.361811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a66b6a-2e1b-4ea2-b523-3452431771ab None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.374733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 387/782] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/endpoints?service_id=787ec546f9414ba49104d46b9d90f64a&interface=public®ion_id=RegionOne => generated 194 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:12.379928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a66b6a-2e1b-4ea2-b523-3452431771ab None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.387952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.405970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6243cf03-12e9-4222-a126-142ddea82c58 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.448148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a5264-ffa0-43ec-a326-0b8622e131ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.448636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a5264-ffa0-43ec-a326-0b8622e131ff None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.448915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a5264-ffa0-43ec-a326-0b8622e131ff None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.449190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a5264-ffa0-43ec-a326-0b8622e131ff None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.449896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a5264-ffa0-43ec-a326-0b8622e131ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.450203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a5264-ffa0-43ec-a326-0b8622e131ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.452132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40a5264-ffa0-43ec-a326-0b8622e131ff None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.476463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 396/783] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:12.480722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a5264-ffa0-43ec-a326-0b8622e131ff None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.540767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.571839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a66b6a-2e1b-4ea2-b523-3452431771ab None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.635459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e5d68-b70d-447b-be9b-715d5a15c73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.636080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e5d68-b70d-447b-be9b-715d5a15c73d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.636359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e5d68-b70d-447b-be9b-715d5a15c73d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.636633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e5d68-b70d-447b-be9b-715d5a15c73d None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.637245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e5d68-b70d-447b-be9b-715d5a15c73d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.638671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e5d68-b70d-447b-be9b-715d5a15c73d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.650551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 388/784] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/services => generated 772 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:12.659843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a5264-ffa0-43ec-a326-0b8622e131ff None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.702277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ee6e9a-00f5-4408-bdbc-7e46d88ed8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.702958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee6e9a-00f5-4408-bdbc-7e46d88ed8d2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.703244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee6e9a-00f5-4408-bdbc-7e46d88ed8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.703525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ee6e9a-00f5-4408-bdbc-7e46d88ed8d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.723586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee6e9a-00f5-4408-bdbc-7e46d88ed8d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.725084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ee6e9a-00f5-4408-bdbc-7e46d88ed8d2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.737173 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-f9ee6e9a-00f5-4408-bdbc-7e46d88ed8d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:12.744412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:12.745635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:12.746513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:12.746513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:12.746513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:12.750832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 397/785] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:12.756622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e5d68-b70d-447b-be9b-715d5a15c73d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.901320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb827e-decd-4027-aa4b-d68367d52400 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.901646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb827e-decd-4027-aa4b-d68367d52400 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.901843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb827e-decd-4027-aa4b-d68367d52400 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.902634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e5d68-b70d-447b-be9b-715d5a15c73d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:12.905301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 398/786] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:12.910522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfd3b8-9d99-4449-8fc9-4518a56c1670 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.910810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfd3b8-9d99-4449-8fc9-4518a56c1670 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.911094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cfd3b8-9d99-4449-8fc9-4518a56c1670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.939815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f126a-0093-483e-9b27-3b5afa818d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:12.940145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-63cfd3b8-9d99-4449-8fc9-4518a56c1670 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:12.940986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f126a-0093-483e-9b27-3b5afa818d9f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:12.941330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-63cfd3b8-9d99-4449-8fc9-4518a56c1670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:12.941722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f126a-0093-483e-9b27-3b5afa818d9f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:12.942192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f126a-0093-483e-9b27-3b5afa818d9f None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:12.943036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f126a-0093-483e-9b27-3b5afa818d9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:12.943551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f126a-0093-483e-9b27-3b5afa818d9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:12.945121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f126a-0093-483e-9b27-3b5afa818d9f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:12.959992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 389/787] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:12.966016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f126a-0093-483e-9b27-3b5afa818d9f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:12.969957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.031386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 399/788] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:13.078227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f126a-0093-483e-9b27-3b5afa818d9f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.114534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab796-5363-4800-9d21-c3dc2130c010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.115505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab796-5363-4800-9d21-c3dc2130c010 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.116016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab796-5363-4800-9d21-c3dc2130c010 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.116508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ab796-5363-4800-9d21-c3dc2130c010 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.124045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ab796-5363-4800-9d21-c3dc2130c010 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.125761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ab796-5363-4800-9d21-c3dc2130c010 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-136ab796-5363-4800-9d21-c3dc2130c010 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:13.137771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:13.139270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:13.140232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:13.142727 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 390/789] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:13.148602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfd3b8-9d99-4449-8fc9-4518a56c1670 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.284133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cfd3b8-9d99-4449-8fc9-4518a56c1670 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.322031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.330992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d904e6-7e99-41a2-8adb-c2bb62eea369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.331622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d904e6-7e99-41a2-8adb-c2bb62eea369 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.331906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d904e6-7e99-41a2-8adb-c2bb62eea369 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.332182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d904e6-7e99-41a2-8adb-c2bb62eea369 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.332927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d904e6-7e99-41a2-8adb-c2bb62eea369 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:13.333238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d904e6-7e99-41a2-8adb-c2bb62eea369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.334724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d904e6-7e99-41a2-8adb-c2bb62eea369 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.359911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 400/790] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:13.365202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab796-5363-4800-9d21-c3dc2130c010 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.423140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d904e6-7e99-41a2-8adb-c2bb62eea369 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.463126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.540133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ab796-5363-4800-9d21-c3dc2130c010 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.550229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d904e6-7e99-41a2-8adb-c2bb62eea369 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.592431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3898c3-c438-47c0-a33b-454003941ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.593301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3898c3-c438-47c0-a33b-454003941ad5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.593601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3898c3-c438-47c0-a33b-454003941ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.593869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3898c3-c438-47c0-a33b-454003941ad5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.612841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6184d-8d11-4803-8e06-f9b92d892483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.613572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6184d-8d11-4803-8e06-f9b92d892483 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.613849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6184d-8d11-4803-8e06-f9b92d892483 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.614118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6184d-8d11-4803-8e06-f9b92d892483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.616893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3898c3-c438-47c0-a33b-454003941ad5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-3f3898c3-c438-47c0-a33b-454003941ad5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:13.622176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:13.623693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:13.624519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 401/791] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:13.625209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8cbc-0444-46e4-9e39-7e6fc6497493 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.626170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8cbc-0444-46e4-9e39-7e6fc6497493 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.626170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c8cbc-0444-46e4-9e39-7e6fc6497493 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.628398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 402/792] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:13.634422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c8cbc-0444-46e4-9e39-7e6fc6497493 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.637006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6184d-8d11-4803-8e06-f9b92d892483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.638597 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6184d-8d11-4803-8e06-f9b92d892483 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-adc6184d-8d11-4803-8e06-f9b92d892483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:13.654106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:13.656298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:13.658432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:13.658432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:13.658432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:13.658432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 391/793] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:13.658432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b89cd-fb8a-48fc-a209-2ae8779fedff None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.658432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b89cd-fb8a-48fc-a209-2ae8779fedff None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.658432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b89cd-fb8a-48fc-a209-2ae8779fedff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.682762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-4f1b89cd-fb8a-48fc-a209-2ae8779fedff None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:13.684011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4f1b89cd-fb8a-48fc-a209-2ae8779fedff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:13.688235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.745987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7c8cbc-0444-46e4-9e39-7e6fc6497493 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.766032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 392/794] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:13.767308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b89cd-fb8a-48fc-a209-2ae8779fedff None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.813997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a74971-59ac-4ba9-b7f2-85f5dbe40b1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.814681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a74971-59ac-4ba9-b7f2-85f5dbe40b1a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.815050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a74971-59ac-4ba9-b7f2-85f5dbe40b1a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.815415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a74971-59ac-4ba9-b7f2-85f5dbe40b1a None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.816191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a74971-59ac-4ba9-b7f2-85f5dbe40b1a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:13.816597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a74971-59ac-4ba9-b7f2-85f5dbe40b1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:13.818008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a74971-59ac-4ba9-b7f2-85f5dbe40b1a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:13.818912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:13.828915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 403/795] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:13.834756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a74971-59ac-4ba9-b7f2-85f5dbe40b1a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:13.930286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b89cd-fb8a-48fc-a209-2ae8779fedff None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.997326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eeeb04-654e-46f5-b2da-ce953ecb2159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:13.998054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeeb04-654e-46f5-b2da-ce953ecb2159 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:13.998339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeeb04-654e-46f5-b2da-ce953ecb2159 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:13.998616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eeeb04-654e-46f5-b2da-ce953ecb2159 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:13.999286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeeb04-654e-46f5-b2da-ce953ecb2159 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:13.999471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a74971-59ac-4ba9-b7f2-85f5dbe40b1a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:13.999649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeeb04-654e-46f5-b2da-ce953ecb2159 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.001147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eeeb04-654e-46f5-b2da-ce953ecb2159 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.011339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.014969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 393/796] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:14.016360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a0e3-2980-4ba7-94ef-8e851dc240d4 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.016702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a0e3-2980-4ba7-94ef-8e851dc240d4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.016988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7a0e3-2980-4ba7-94ef-8e851dc240d4 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.022417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 394/797] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:14.023284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7a0e3-2980-4ba7-94ef-8e851dc240d4 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.038192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf6bb48-f761-48e1-9303-e6ca0ce3288b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.038819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6bb48-f761-48e1-9303-e6ca0ce3288b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.039094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6bb48-f761-48e1-9303-e6ca0ce3288b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.039363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf6bb48-f761-48e1-9303-e6ca0ce3288b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.050869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6bb48-f761-48e1-9303-e6ca0ce3288b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.052303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf6bb48-f761-48e1-9303-e6ca0ce3288b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-ebf6bb48-f761-48e1-9303-e6ca0ce3288b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:14.067935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:14.068862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:14.069965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:14.069965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:14.069965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:14.069965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 404/798] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:14.074836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f418-c8a7-4dc1-b4ce-713e80f99a5c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.075116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f418-c8a7-4dc1-b4ce-713e80f99a5c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.075389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f418-c8a7-4dc1-b4ce-713e80f99a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.094032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7cb6f418-c8a7-4dc1-b4ce-713e80f99a5c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:14.095210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7cb6f418-c8a7-4dc1-b4ce-713e80f99a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:14.134895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7a0e3-2980-4ba7-94ef-8e851dc240d4 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.137979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.166818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 405/799] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:14.167930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6f418-c8a7-4dc1-b4ce-713e80f99a5c None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.186723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c0b10-4f67-4dc8-9c16-d159f5686049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.187363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c0b10-4f67-4dc8-9c16-d159f5686049 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.187700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c0b10-4f67-4dc8-9c16-d159f5686049 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.187978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317c0b10-4f67-4dc8-9c16-d159f5686049 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.195384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c0b10-4f67-4dc8-9c16-d159f5686049 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.196968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317c0b10-4f67-4dc8-9c16-d159f5686049 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-317c0b10-4f67-4dc8-9c16-d159f5686049 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:14.208994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:14.209924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:14.210808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:14.210808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:14.210808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:14.210808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:14.210808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:14.210808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:14.210808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:14.210808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:14.210808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 395/800] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:14.211796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c0b10-4f67-4dc8-9c16-d159f5686049 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.296876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.313065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6f418-c8a7-4dc1-b4ce-713e80f99a5c None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.327534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317c0b10-4f67-4dc8-9c16-d159f5686049 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.357663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471bffa-bab9-4b2f-afae-c48763601e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.358863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471bffa-bab9-4b2f-afae-c48763601e12 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.359760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471bffa-bab9-4b2f-afae-c48763601e12 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.360500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4471bffa-bab9-4b2f-afae-c48763601e12 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.361542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471bffa-bab9-4b2f-afae-c48763601e12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:14.362125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471bffa-bab9-4b2f-afae-c48763601e12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.364008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4471bffa-bab9-4b2f-afae-c48763601e12 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.364299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84839-a9f4-4cc2-9073-8762c11a8b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.364931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84839-a9f4-4cc2-9073-8762c11a8b86 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.365212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84839-a9f4-4cc2-9073-8762c11a8b86 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.365520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d84839-a9f4-4cc2-9073-8762c11a8b86 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.366115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84839-a9f4-4cc2-9073-8762c11a8b86 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.367469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d84839-a9f4-4cc2-9073-8762c11a8b86 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-03d84839-a9f4-4cc2-9073-8762c11a8b86 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:14.377138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:14.378199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:14.379035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 396/801] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:14.379828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84839-a9f4-4cc2-9073-8762c11a8b86 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.385738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 406/802] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:14.387300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471bffa-bab9-4b2f-afae-c48763601e12 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.413172 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.501718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d84839-a9f4-4cc2-9073-8762c11a8b86 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.515705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4471bffa-bab9-4b2f-afae-c48763601e12 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.537418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b6d5-8a41-428b-b01d-57b2388fffb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.538135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b6d5-8a41-428b-b01d-57b2388fffb3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.538481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b6d5-8a41-428b-b01d-57b2388fffb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.538823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b9b6d5-8a41-428b-b01d-57b2388fffb3 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.539520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b6d5-8a41-428b-b01d-57b2388fffb3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:14.539822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b6d5-8a41-428b-b01d-57b2388fffb3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.541253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b9b6d5-8a41-428b-b01d-57b2388fffb3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.550645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985a7b4-aedd-4b40-805d-57ceac9ea80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.551769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985a7b4-aedd-4b40-805d-57ceac9ea80c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.552190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985a7b4-aedd-4b40-805d-57ceac9ea80c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.552601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f985a7b4-aedd-4b40-805d-57ceac9ea80c None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.553359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985a7b4-aedd-4b40-805d-57ceac9ea80c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:14.553824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985a7b4-aedd-4b40-805d-57ceac9ea80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.554245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 397/803] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:14.555027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b6d5-8a41-428b-b01d-57b2388fffb3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.555678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f985a7b4-aedd-4b40-805d-57ceac9ea80c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.563014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 407/804] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:14.563942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985a7b4-aedd-4b40-805d-57ceac9ea80c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.584875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.658563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.672296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b9b6d5-8a41-428b-b01d-57b2388fffb3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.710498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6407d6a-b483-4b7c-9563-8eaa6dd45661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.711155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407d6a-b483-4b7c-9563-8eaa6dd45661 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.711434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407d6a-b483-4b7c-9563-8eaa6dd45661 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.711708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6407d6a-b483-4b7c-9563-8eaa6dd45661 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.720891 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6407d6a-b483-4b7c-9563-8eaa6dd45661 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.722407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6407d6a-b483-4b7c-9563-8eaa6dd45661 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-b6407d6a-b483-4b7c-9563-8eaa6dd45661 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:14.736040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:14.737066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:14.738402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 398/805] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:14.738983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6407d6a-b483-4b7c-9563-8eaa6dd45661 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.800597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f985a7b4-aedd-4b40-805d-57ceac9ea80c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.835100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a4df2-9c03-45b8-bec2-dc0ea5d24029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.835640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a4df2-9c03-45b8-bec2-dc0ea5d24029 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.835913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a4df2-9c03-45b8-bec2-dc0ea5d24029 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.836176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a4df2-9c03-45b8-bec2-dc0ea5d24029 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.846378 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6407d6a-b483-4b7c-9563-8eaa6dd45661 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:14.846587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a4df2-9c03-45b8-bec2-dc0ea5d24029 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-3d9a4df2-9c03-45b8-bec2-dc0ea5d24029 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:14.851274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:14.852180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:14.853013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 408/806] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:14.853736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a4df2-9c03-45b8-bec2-dc0ea5d24029 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.890096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45bf87-8411-444d-be25-ccf3b3b405e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:14.891307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45bf87-8411-444d-be25-ccf3b3b405e9 None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:14.892606 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45bf87-8411-444d-be25-ccf3b3b405e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:14.893038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce45bf87-8411-444d-be25-ccf3b3b405e9 None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/6247f16e4bf6497183e40a7ed31ff23c/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:14.895085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45bf87-8411-444d-be25-ccf3b3b405e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=6247f16e4bf6497183e40a7ed31ff23c, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:14.897138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce45bf87-8411-444d-be25-ccf3b3b405e9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:14.917445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 399/807] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:14 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/6247f16e4bf6497183e40a7ed31ff23c/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:14.917445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45bf87-8411-444d-be25-ccf3b3b405e9 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:14.926291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.955992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:14.992040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a4df2-9c03-45b8-bec2-dc0ea5d24029 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.033053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab4ed9-2246-4eff-9b3e-97c1f636d124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.033707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab4ed9-2246-4eff-9b3e-97c1f636d124 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.033983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab4ed9-2246-4eff-9b3e-97c1f636d124 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.034287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ab4ed9-2246-4eff-9b3e-97c1f636d124 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.035021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab4ed9-2246-4eff-9b3e-97c1f636d124 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:15.035322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab4ed9-2246-4eff-9b3e-97c1f636d124 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.041432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ab4ed9-2246-4eff-9b3e-97c1f636d124 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.048096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 409/808] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:15.049062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab4ed9-2246-4eff-9b3e-97c1f636d124 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:15.093701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce45bf87-8411-444d-be25-ccf3b3b405e9 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.141130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083e66b-2eb1-442f-99c1-268b10214629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.141779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083e66b-2eb1-442f-99c1-268b10214629 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.142054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083e66b-2eb1-442f-99c1-268b10214629 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.142326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c083e66b-2eb1-442f-99c1-268b10214629 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.143068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083e66b-2eb1-442f-99c1-268b10214629 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:15.143384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083e66b-2eb1-442f-99c1-268b10214629 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.144812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c083e66b-2eb1-442f-99c1-268b10214629 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.166032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 400/809] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:14 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:15.166862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083e66b-2eb1-442f-99c1-268b10214629 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:15.184572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ab4ed9-2246-4eff-9b3e-97c1f636d124 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.222540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff29861-6e77-479c-9012-3986e709adc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.223566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff29861-6e77-479c-9012-3986e709adc2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.224307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff29861-6e77-479c-9012-3986e709adc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.224732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff29861-6e77-479c-9012-3986e709adc2 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.225582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff29861-6e77-479c-9012-3986e709adc2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:15.226040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff29861-6e77-479c-9012-3986e709adc2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.227667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff29861-6e77-479c-9012-3986e709adc2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.242373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 410/810] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:36:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:15.242373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff29861-6e77-479c-9012-3986e709adc2 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:15.242613 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:15.245331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:15.291866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c083e66b-2eb1-442f-99c1-268b10214629 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.334068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efda106-d187-418f-8a6d-d4668006e01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.334746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efda106-d187-418f-8a6d-d4668006e01c None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.335027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efda106-d187-418f-8a6d-d4668006e01c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.335296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efda106-d187-418f-8a6d-d4668006e01c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.335963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efda106-d187-418f-8a6d-d4668006e01c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.337355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efda106-d187-418f-8a6d-d4668006e01c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.369459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff29861-6e77-479c-9012-3986e709adc2 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.373499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 401/811] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:15.375628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efda106-d187-418f-8a6d-d4668006e01c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:15.456864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de89e54e-d4d1-457a-880f-8b678e4ae5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.457511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e54e-d4d1-457a-880f-8b678e4ae5da None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.457787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e54e-d4d1-457a-880f-8b678e4ae5da None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.458057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de89e54e-d4d1-457a-880f-8b678e4ae5da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.528689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efda106-d187-418f-8a6d-d4668006e01c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.542331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:15.548573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89e54e-d4d1-457a-880f-8b678e4ae5da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.550220 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de89e54e-d4d1-457a-880f-8b678e4ae5da None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.562882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:15.582813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031392aa-18d2-45d7-a50c-aa6158e4fe34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.582813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031392aa-18d2-45d7-a50c-aa6158e4fe34 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.583114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031392aa-18d2-45d7-a50c-aa6158e4fe34 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.583199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031392aa-18d2-45d7-a50c-aa6158e4fe34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.594753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031392aa-18d2-45d7-a50c-aa6158e4fe34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.596317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031392aa-18d2-45d7-a50c-aa6158e4fe34 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-031392aa-18d2-45d7-a50c-aa6158e4fe34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:15.611309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:15.612288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:15.613187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:15.613187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:15.613187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:15.613187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 402/812] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:15.613845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d771be5-5712-4d37-a30a-629ebeb5f289 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.614133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d771be5-5712-4d37-a30a-629ebeb5f289 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.614310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d771be5-5712-4d37-a30a-629ebeb5f289 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.615764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 403/813] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:15.618201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d771be5-5712-4d37-a30a-629ebeb5f289 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:15.677059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 411/814] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:15 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:15.678564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d1d66-45ef-48b2-9a94-205de6aa1d5b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.678946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d1d66-45ef-48b2-9a94-205de6aa1d5b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.679320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d1d66-45ef-48b2-9a94-205de6aa1d5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.698106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-082d1d66-45ef-48b2-9a94-205de6aa1d5b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:15.699449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-082d1d66-45ef-48b2-9a94-205de6aa1d5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:15.751004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d771be5-5712-4d37-a30a-629ebeb5f289 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.771600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 412/815] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:15.772741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d1d66-45ef-48b2-9a94-205de6aa1d5b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:15.797966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38efdbd-580c-4390-be4d-6721200c9c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.798748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38efdbd-580c-4390-be4d-6721200c9c78 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.799123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38efdbd-580c-4390-be4d-6721200c9c78 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.799496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38efdbd-580c-4390-be4d-6721200c9c78 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.800246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38efdbd-580c-4390-be4d-6721200c9c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:15.800648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38efdbd-580c-4390-be4d-6721200c9c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.802221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38efdbd-580c-4390-be4d-6721200c9c78 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.806782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:15.825103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 404/816] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:15.831611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38efdbd-580c-4390-be4d-6721200c9c78 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:15.895500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d1d66-45ef-48b2-9a94-205de6aa1d5b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:15.896033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:15.940603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208321-250e-441c-b76a-6673c54ab103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:15.941204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208321-250e-441c-b76a-6673c54ab103 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:15.941509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208321-250e-441c-b76a-6673c54ab103 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:15.941778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17208321-250e-441c-b76a-6673c54ab103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:15.954111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17208321-250e-441c-b76a-6673c54ab103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:15.956118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17208321-250e-441c-b76a-6673c54ab103 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-17208321-250e-441c-b76a-6673c54ab103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:15.976410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:15.978634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:15.980746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:15.980746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:15.980746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:15.980746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 413/817] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:15.984911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208321-250e-441c-b76a-6673c54ab103 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.052859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38efdbd-580c-4390-be4d-6721200c9c78 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.090439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.092072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054b068-9a8b-49ce-9d5b-ef10fd0a02db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.092834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054b068-9a8b-49ce-9d5b-ef10fd0a02db None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.093217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054b068-9a8b-49ce-9d5b-ef10fd0a02db None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.093617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054b068-9a8b-49ce-9d5b-ef10fd0a02db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.101256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054b068-9a8b-49ce-9d5b-ef10fd0a02db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.102884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054b068-9a8b-49ce-9d5b-ef10fd0a02db None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.103945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17208321-250e-441c-b76a-6673c54ab103 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-a054b068-9a8b-49ce-9d5b-ef10fd0a02db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:16.115319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:16.117083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 405/818] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:16.119010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054b068-9a8b-49ce-9d5b-ef10fd0a02db None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.144942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a848c-de19-4057-9ef4-216f3c6879e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.145769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a848c-de19-4057-9ef4-216f3c6879e3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.146225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a848c-de19-4057-9ef4-216f3c6879e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.146592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a848c-de19-4057-9ef4-216f3c6879e3 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.147328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a848c-de19-4057-9ef4-216f3c6879e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:16.147726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a848c-de19-4057-9ef4-216f3c6879e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.149194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0a848c-de19-4057-9ef4-216f3c6879e3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.161462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 414/819] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:16.162679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a848c-de19-4057-9ef4-216f3c6879e3 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.245182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.253977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054b068-9a8b-49ce-9d5b-ef10fd0a02db None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.269194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0a848c-de19-4057-9ef4-216f3c6879e3 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.290650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548e0bf-ac4a-4dfc-90b1-0da77fd6af62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.291560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548e0bf-ac4a-4dfc-90b1-0da77fd6af62 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.292055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548e0bf-ac4a-4dfc-90b1-0da77fd6af62 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.292470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7548e0bf-ac4a-4dfc-90b1-0da77fd6af62 None admin] PATH_INFO: `/v3/services/network` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.293193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548e0bf-ac4a-4dfc-90b1-0da77fd6af62 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.295460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7548e0bf-ac4a-4dfc-90b1-0da77fd6af62 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-7548e0bf-ac4a-4dfc-90b1-0da77fd6af62 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:16.305325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:16.306457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 17 00:36:16.307282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:16.308012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e45077-80d6-4fc2-81d5-73c622eddd59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.308012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e45077-80d6-4fc2-81d5-73c622eddd59 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.308012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e45077-80d6-4fc2-81d5-73c622eddd59 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.308012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e45077-80d6-4fc2-81d5-73c622eddd59 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.308285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e45077-80d6-4fc2-81d5-73c622eddd59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:16.308285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e45077-80d6-4fc2-81d5-73c622eddd59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.309564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e45077-80d6-4fc2-81d5-73c622eddd59 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.310281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 406/820] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:16.313298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548e0bf-ac4a-4dfc-90b1-0da77fd6af62 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.324409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.335873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 415/821] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:16.341089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e45077-80d6-4fc2-81d5-73c622eddd59 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.425784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7548e0bf-ac4a-4dfc-90b1-0da77fd6af62 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.440810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e45077-80d6-4fc2-81d5-73c622eddd59 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.461128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77395283-aae3-4f3a-a0a2-ce5b0eacd449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.462109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77395283-aae3-4f3a-a0a2-ce5b0eacd449 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.462607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77395283-aae3-4f3a-a0a2-ce5b0eacd449 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.463080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77395283-aae3-4f3a-a0a2-ce5b0eacd449 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.471013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77395283-aae3-4f3a-a0a2-ce5b0eacd449 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.472655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77395283-aae3-4f3a-a0a2-ce5b0eacd449 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.476450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c97e-0344-4b6a-a203-a002dc429da9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.477052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c97e-0344-4b6a-a203-a002dc429da9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.477327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c97e-0344-4b6a-a203-a002dc429da9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.477630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf1c97e-0344-4b6a-a203-a002dc429da9 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.478255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c97e-0344-4b6a-a203-a002dc429da9 None admin] RBAC: Adding query filter params (name=network) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:16.478553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c97e-0344-4b6a-a203-a002dc429da9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.479949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf1c97e-0344-4b6a-a203-a002dc429da9 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-77395283-aae3-4f3a-a0a2-ce5b0eacd449 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:16.486515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:16.487402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:16.488292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:16.488292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:16.488292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:16.488292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:16.488292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:16.488292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:16.488292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:16.488292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:16.489270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 416/822] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:16.490144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c97e-0344-4b6a-a203-a002dc429da9 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.495457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 407/823] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:16.496503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77395283-aae3-4f3a-a0a2-ce5b0eacd449 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.518510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.558677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.601870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf1c97e-0344-4b6a-a203-a002dc429da9 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.602925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77395283-aae3-4f3a-a0a2-ce5b0eacd449 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.637307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27885d76-9996-4c8b-8770-46431e80c49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.638096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27885d76-9996-4c8b-8770-46431e80c49d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.638614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27885d76-9996-4c8b-8770-46431e80c49d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.638986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27885d76-9996-4c8b-8770-46431e80c49d None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.639476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862aa6-32a2-425b-98df-861104456b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.639799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27885d76-9996-4c8b-8770-46431e80c49d None admin] RBAC: Adding query filter params (type=network) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:16.640196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27885d76-9996-4c8b-8770-46431e80c49d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.640620 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862aa6-32a2-425b-98df-861104456b40 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.641033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862aa6-32a2-425b-98df-861104456b40 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.641547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13862aa6-32a2-425b-98df-861104456b40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.642073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27885d76-9996-4c8b-8770-46431e80c49d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.651888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 408/824] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:16.651888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27885d76-9996-4c8b-8770-46431e80c49d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.658164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13862aa6-32a2-425b-98df-861104456b40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.659866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13862aa6-32a2-425b-98df-861104456b40 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-13862aa6-32a2-425b-98df-861104456b40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:16.675882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:16.676911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:16.678240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:16.678240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:16.678240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:16.680384 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 417/825] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:16.681359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862aa6-32a2-425b-98df-861104456b40 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.736808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.756230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27885d76-9996-4c8b-8770-46431e80c49d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.790384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312d5c9-89ff-46b2-90eb-9d22bbf14407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.791083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312d5c9-89ff-46b2-90eb-9d22bbf14407 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.791450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312d5c9-89ff-46b2-90eb-9d22bbf14407 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.791658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13862aa6-32a2-425b-98df-861104456b40 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:16.791807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f312d5c9-89ff-46b2-90eb-9d22bbf14407 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.792583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312d5c9-89ff-46b2-90eb-9d22bbf14407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:16.792952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312d5c9-89ff-46b2-90eb-9d22bbf14407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.795846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f312d5c9-89ff-46b2-90eb-9d22bbf14407 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.807730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:16.813497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 409/826] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:16.814693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312d5c9-89ff-46b2-90eb-9d22bbf14407 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.831087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe293c79-ea6f-4624-8926-cdbbf5418fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:16.831758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe293c79-ea6f-4624-8926-cdbbf5418fb4 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:16.832136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe293c79-ea6f-4624-8926-cdbbf5418fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:16.832503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe293c79-ea6f-4624-8926-cdbbf5418fb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:16.833264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe293c79-ea6f-4624-8926-cdbbf5418fb4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:16.835008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe293c79-ea6f-4624-8926-cdbbf5418fb4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:16.862466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 418/827] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:16 2022] POST /identity/v3/endpoints => generated 337 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:16.866566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe293c79-ea6f-4624-8926-cdbbf5418fb4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:16.997964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f312d5c9-89ff-46b2-90eb-9d22bbf14407 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.056281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901ee7d-8b6c-4a55-bbc3-714eb8a7deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.057216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901ee7d-8b6c-4a55-bbc3-714eb8a7deff None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.057666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901ee7d-8b6c-4a55-bbc3-714eb8a7deff None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.058134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901ee7d-8b6c-4a55-bbc3-714eb8a7deff None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.058925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901ee7d-8b6c-4a55-bbc3-714eb8a7deff None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:17.059370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901ee7d-8b6c-4a55-bbc3-714eb8a7deff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.060982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6901ee7d-8b6c-4a55-bbc3-714eb8a7deff None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.071107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.077515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 410/828] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:17.080840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901ee7d-8b6c-4a55-bbc3-714eb8a7deff None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.094767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe293c79-ea6f-4624-8926-cdbbf5418fb4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.134167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a2636-69f1-42a2-bc38-fcfa32c45133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.135020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2636-69f1-42a2-bc38-fcfa32c45133 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.135394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2636-69f1-42a2-bc38-fcfa32c45133 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.136527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a2636-69f1-42a2-bc38-fcfa32c45133 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.136527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a2636-69f1-42a2-bc38-fcfa32c45133 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=2dbd23de9096446091fb9b7f79f047fc) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:17.136937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a2636-69f1-42a2-bc38-fcfa32c45133 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.138707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a2636-69f1-42a2-bc38-fcfa32c45133 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.150300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 419/829] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:16 2022] GET /identity/v3/role_assignments?user.id=2dbd23de9096446091fb9b7f79f047fc&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:17.226980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6901ee7d-8b6c-4a55-bbc3-714eb8a7deff None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.274428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad8108-9ccc-4aff-be72-7531dade91d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.275478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad8108-9ccc-4aff-be72-7531dade91d7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.276174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad8108-9ccc-4aff-be72-7531dade91d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.276645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad8108-9ccc-4aff-be72-7531dade91d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.278573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d1551-f6b7-43ba-9b23-914003b2bdd1 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.278573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d1551-f6b7-43ba-9b23-914003b2bdd1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.278573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7d1551-f6b7-43ba-9b23-914003b2bdd1 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.280593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 420/830] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:17.287273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad8108-9ccc-4aff-be72-7531dade91d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.287453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff58c2b-bb44-4579-ae02-0407fe6f1820 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.287646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff58c2b-bb44-4579-ae02-0407fe6f1820 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.287838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff58c2b-bb44-4579-ae02-0407fe6f1820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.289516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad8108-9ccc-4aff-be72-7531dade91d7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-41ad8108-9ccc-4aff-be72-7531dade91d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:17.305249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:17.306445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:17.307527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:17.307527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:17.307527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:17.307527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:17.307527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:17.307527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:17.307527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:17.307527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:17.308966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-cff58c2b-bb44-4579-ae02-0407fe6f1820 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:17.310847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-cff58c2b-bb44-4579-ae02-0407fe6f1820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:17.311646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 411/831] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:17.317639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad8108-9ccc-4aff-be72-7531dade91d7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.350672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.398130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.400557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 421/832] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:17.450627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad8108-9ccc-4aff-be72-7531dade91d7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.488624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e08bc-fe0e-4b6d-ac4d-f83bc5e8831b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.489232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e08bc-fe0e-4b6d-ac4d-f83bc5e8831b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.489549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e08bc-fe0e-4b6d-ac4d-f83bc5e8831b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.489819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0e08bc-fe0e-4b6d-ac4d-f83bc5e8831b None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.490507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e08bc-fe0e-4b6d-ac4d-f83bc5e8831b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:17.490807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e08bc-fe0e-4b6d-ac4d-f83bc5e8831b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.492231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0e08bc-fe0e-4b6d-ac4d-f83bc5e8831b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.505183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 412/833] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:17.510776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff58c2b-bb44-4579-ae02-0407fe6f1820 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.613474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff58c2b-bb44-4579-ae02-0407fe6f1820 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.649702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480a21c2-ab1b-489c-88bf-4d14c4e6174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.650372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a21c2-ab1b-489c-88bf-4d14c4e6174e None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.650648 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a21c2-ab1b-489c-88bf-4d14c4e6174e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.650915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480a21c2-ab1b-489c-88bf-4d14c4e6174e None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/e639d502dd3c46199da050a0f71de561/roles/0262a124652e4e13a6dc455c2cc2ffb7` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.666548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a21c2-ab1b-489c-88bf-4d14c4e6174e None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=e639d502dd3c46199da050a0f71de561, role_id=0262a124652e4e13a6dc455c2cc2ffb7)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:17.667981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480a21c2-ab1b-489c-88bf-4d14c4e6174e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:17.674855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e08bc-fe0e-4b6d-ac4d-f83bc5e8831b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.683335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 422/834] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:17 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/e639d502dd3c46199da050a0f71de561/roles/0262a124652e4e13a6dc455c2cc2ffb7 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:17.798745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0e08bc-fe0e-4b6d-ac4d-f83bc5e8831b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:17.819220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.840821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c4b18-72e5-48d0-aa0b-4921be3915b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:17.842333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c4b18-72e5-48d0-aa0b-4921be3915b1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.842456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6104-5ccd-49f4-8994-bd60ba271ab4 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.842728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6104-5ccd-49f4-8994-bd60ba271ab4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.843000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d6104-5ccd-49f4-8994-bd60ba271ab4 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.843189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c4b18-72e5-48d0-aa0b-4921be3915b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.843611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c4b18-72e5-48d0-aa0b-4921be3915b1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.849296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 423/835] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:17.851099 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625981e9-9e2b-49a8-a6a7-bd4f5c7b12ab None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:17.851362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625981e9-9e2b-49a8-a6a7-bd4f5c7b12ab None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:17.851642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625981e9-9e2b-49a8-a6a7-bd4f5c7b12ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:17.857813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c4b18-72e5-48d0-aa0b-4921be3915b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-4c6c4b18-72e5-48d0-aa0b-4921be3915b1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:17.863125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:17.864330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:17.865384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:17.867715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 413/836] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:17.873265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c4b18-72e5-48d0-aa0b-4921be3915b1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:17.874350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-625981e9-9e2b-49a8-a6a7-bd4f5c7b12ab None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:17.875548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-625981e9-9e2b-49a8-a6a7-bd4f5c7b12ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:17.886806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:17.968776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 424/837] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:17.993805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c4b18-72e5-48d0-aa0b-4921be3915b1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.037744 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6be60-8121-47a9-8a8d-efbae6ebc58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.038361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6be60-8121-47a9-8a8d-efbae6ebc58d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.038642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6be60-8121-47a9-8a8d-efbae6ebc58d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.038912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be6be60-8121-47a9-8a8d-efbae6ebc58d None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.039575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6be60-8121-47a9-8a8d-efbae6ebc58d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:18.039874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6be60-8121-47a9-8a8d-efbae6ebc58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.041238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be6be60-8121-47a9-8a8d-efbae6ebc58d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.050604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 414/838] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:18.057362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625981e9-9e2b-49a8-a6a7-bd4f5c7b12ab None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.159211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625981e9-9e2b-49a8-a6a7-bd4f5c7b12ab None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.193424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbde9f-18c9-425d-a8d4-b3d6981198e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.194054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbde9f-18c9-425d-a8d4-b3d6981198e3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.194327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbde9f-18c9-425d-a8d4-b3d6981198e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.194591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbde9f-18c9-425d-a8d4-b3d6981198e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.206325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbde9f-18c9-425d-a8d4-b3d6981198e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.207753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbde9f-18c9-425d-a8d4-b3d6981198e3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.210855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-c8cbde9f-18c9-425d-a8d4-b3d6981198e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:18.224552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:18.225563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:18.226473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:18.226473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:18.226473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:18.226473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 425/839] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:18.231780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6be60-8121-47a9-8a8d-efbae6ebc58d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.252340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbde9f-18c9-425d-a8d4-b3d6981198e3 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.281167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.343064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be6be60-8121-47a9-8a8d-efbae6ebc58d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.377942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985c300-59b7-426e-9125-5bf63720c01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.378543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985c300-59b7-426e-9125-5bf63720c01b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.378821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985c300-59b7-426e-9125-5bf63720c01b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.379090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985c300-59b7-426e-9125-5bf63720c01b None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.379782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985c300-59b7-426e-9125-5bf63720c01b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:18.380083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985c300-59b7-426e-9125-5bf63720c01b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.381481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985c300-59b7-426e-9125-5bf63720c01b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.388070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbde9f-18c9-425d-a8d4-b3d6981198e3 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.398458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 415/840] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:18.399465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985c300-59b7-426e-9125-5bf63720c01b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.442440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ae665-7c6b-4b36-95ec-8315dbc8f31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.443476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ae665-7c6b-4b36-95ec-8315dbc8f31d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.444207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ae665-7c6b-4b36-95ec-8315dbc8f31d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.445618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ae665-7c6b-4b36-95ec-8315dbc8f31d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.446237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ae665-7c6b-4b36-95ec-8315dbc8f31d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.447600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ae665-7c6b-4b36-95ec-8315dbc8f31d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-895ae665-7c6b-4b36-95ec-8315dbc8f31d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:18.461579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:18.462598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:18.463803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:18.468119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 426/841] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:18.473545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ae665-7c6b-4b36-95ec-8315dbc8f31d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.534778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.539567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985c300-59b7-426e-9125-5bf63720c01b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.545841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.595106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ee57b-5a1a-4332-8be4-a06e4b3b63bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.595606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ae665-7c6b-4b36-95ec-8315dbc8f31d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.595786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ee57b-5a1a-4332-8be4-a06e4b3b63bc None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.596051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ee57b-5a1a-4332-8be4-a06e4b3b63bc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.596322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ee57b-5a1a-4332-8be4-a06e4b3b63bc None admin] PATH_INFO: `/v3/users/swift` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.605870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ee57b-5a1a-4332-8be4-a06e4b3b63bc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.607759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ee57b-5a1a-4332-8be4-a06e4b3b63bc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-d94ee57b-5a1a-4332-8be4-a06e4b3b63bc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:18.624284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:18.625252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 17 00:36:18.626233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:18.629470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 416/842] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:18.632488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ee57b-5a1a-4332-8be4-a06e4b3b63bc None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.640604 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c95c22-40cc-4092-bcc6-535645ca78af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.641642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c95c22-40cc-4092-bcc6-535645ca78af None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.642122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c95c22-40cc-4092-bcc6-535645ca78af None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.642590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c95c22-40cc-4092-bcc6-535645ca78af None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.643444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c95c22-40cc-4092-bcc6-535645ca78af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:18.643977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c95c22-40cc-4092-bcc6-535645ca78af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.645671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c95c22-40cc-4092-bcc6-535645ca78af None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.651835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 427/843] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:18.657727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c95c22-40cc-4092-bcc6-535645ca78af None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.742403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ee57b-5a1a-4332-8be4-a06e4b3b63bc None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.776710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701c9ee-8b05-4140-a367-28d5c245165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.777686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701c9ee-8b05-4140-a367-28d5c245165e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.778234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701c9ee-8b05-4140-a367-28d5c245165e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.778698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0701c9ee-8b05-4140-a367-28d5c245165e None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.778803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c95c22-40cc-4092-bcc6-535645ca78af None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.780688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701c9ee-8b05-4140-a367-28d5c245165e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:18.781185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701c9ee-8b05-4140-a367-28d5c245165e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.782872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0701c9ee-8b05-4140-a367-28d5c245165e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.801091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 417/844] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:18.806693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701c9ee-8b05-4140-a367-28d5c245165e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:18.810526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.823741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff08f-5c68-4fa1-bd38-f81a1a0b23b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.824813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff08f-5c68-4fa1-bd38-f81a1a0b23b5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.825238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff08f-5c68-4fa1-bd38-f81a1a0b23b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.825679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ff08f-5c68-4fa1-bd38-f81a1a0b23b5 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:18.826575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff08f-5c68-4fa1-bd38-f81a1a0b23b5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:18.827106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:18.827757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff08f-5c68-4fa1-bd38-f81a1a0b23b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:18.829475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ff08f-5c68-4fa1-bd38-f81a1a0b23b5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:18.842139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 428/845] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:18.926243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0701c9ee-8b05-4140-a367-28d5c245165e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:18.969502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8453b-dfcd-4ba6-9fd7-6274609073e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:18.970508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8453b-dfcd-4ba6-9fd7-6274609073e2 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:18.970790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8453b-dfcd-4ba6-9fd7-6274609073e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:18.971065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d8453b-dfcd-4ba6-9fd7-6274609073e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.049153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8453b-dfcd-4ba6-9fd7-6274609073e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.050651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d8453b-dfcd-4ba6-9fd7-6274609073e2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.069694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.154511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 418/846] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:18 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 00:36:19.159750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff08f-5c68-4fa1-bd38-f81a1a0b23b5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.265667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ff08f-5c68-4fa1-bd38-f81a1a0b23b5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.305361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d552bb3-6e12-4736-889d-83460dc656e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.305948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d552bb3-6e12-4736-889d-83460dc656e4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.306232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d552bb3-6e12-4736-889d-83460dc656e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.306506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d552bb3-6e12-4736-889d-83460dc656e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.317829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d552bb3-6e12-4736-889d-83460dc656e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.319279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d552bb3-6e12-4736-889d-83460dc656e4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-5d552bb3-6e12-4736-889d-83460dc656e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:19.334221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:19.335211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:19.336117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:19.336117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:19.336117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:19.336117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 429/847] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:19.341580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8453b-dfcd-4ba6-9fd7-6274609073e2 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.454542 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d8453b-dfcd-4ba6-9fd7-6274609073e2 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.475503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.492686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4e0bac-f90e-4c52-83cf-b27cc419544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.493295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e0bac-f90e-4c52-83cf-b27cc419544d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.493629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e0bac-f90e-4c52-83cf-b27cc419544d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.493901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4e0bac-f90e-4c52-83cf-b27cc419544d None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.494538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e0bac-f90e-4c52-83cf-b27cc419544d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:19.494834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e0bac-f90e-4c52-83cf-b27cc419544d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.496192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4e0bac-f90e-4c52-83cf-b27cc419544d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.510097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 419/848] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:19.518897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d552bb3-6e12-4736-889d-83460dc656e4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.565221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.566644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b8f6-cbe4-4784-a44d-01b9f964116e None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.566931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b8f6-cbe4-4784-a44d-01b9f964116e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.567707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c3b8f6-cbe4-4784-a44d-01b9f964116e None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.568779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 420/849] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:19.574784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c918-3172-4d32-a610-b363871534a7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.575189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c918-3172-4d32-a610-b363871534a7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.575572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c918-3172-4d32-a610-b363871534a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.598518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-cf64c918-3172-4d32-a610-b363871534a7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:19.599725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-cf64c918-3172-4d32-a610-b363871534a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:19.637753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d552bb3-6e12-4736-889d-83460dc656e4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.677434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 421/850] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:19.683408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936722-04e9-41a3-9c22-75871338e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.684024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936722-04e9-41a3-9c22-75871338e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.684301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936722-04e9-41a3-9c22-75871338e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.684576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a936722-04e9-41a3-9c22-75871338e8b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.692153 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a936722-04e9-41a3-9c22-75871338e8b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.693623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a936722-04e9-41a3-9c22-75871338e8b9 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-9a936722-04e9-41a3-9c22-75871338e8b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:19.705195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:19.706105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:19.706987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:19.706987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:19.706987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:19.706987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:19.706987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:19.706987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:19.706987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:19.706987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:19.706987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 430/851] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:19.713817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c918-3172-4d32-a610-b363871534a7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.818057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c918-3172-4d32-a610-b363871534a7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:19.834078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.857658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66e861-2b26-4869-8aca-39ab16c249a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:19.858305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66e861-2b26-4869-8aca-39ab16c249a3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:19.858583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66e861-2b26-4869-8aca-39ab16c249a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:19.858855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66e861-2b26-4869-8aca-39ab16c249a3 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:19.859579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66e861-2b26-4869-8aca-39ab16c249a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:19.859883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66e861-2b26-4869-8aca-39ab16c249a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:19.861362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a66e861-2b26-4869-8aca-39ab16c249a3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:19.876728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 422/852] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:19.885724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936722-04e9-41a3-9c22-75871338e8b9 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.976978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66e861-2b26-4869-8aca-39ab16c249a3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:19.995098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:19.998983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a936722-04e9-41a3-9c22-75871338e8b9 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.039002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa235b79-e856-47b7-a22b-8cbbf9a51599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.039608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa235b79-e856-47b7-a22b-8cbbf9a51599 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.040009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa235b79-e856-47b7-a22b-8cbbf9a51599 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.040284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa235b79-e856-47b7-a22b-8cbbf9a51599 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.041138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa235b79-e856-47b7-a22b-8cbbf9a51599 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=6247f16e4bf6497183e40a7ed31ff23c) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:20.041484 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa235b79-e856-47b7-a22b-8cbbf9a51599 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:20.043189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa235b79-e856-47b7-a22b-8cbbf9a51599 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:20.049857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 431/853] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/role_assignments?user.id=6247f16e4bf6497183e40a7ed31ff23c&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:20.051070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ab0b-10d5-4d31-ad7b-744557fca3ba None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.051358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ab0b-10d5-4d31-ad7b-744557fca3ba None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.051630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762ab0b-10d5-4d31-ad7b-744557fca3ba None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.053442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 432/854] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:20.058618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729605bd-6514-4f8a-a574-074be003f75c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.058988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729605bd-6514-4f8a-a574-074be003f75c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.059344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729605bd-6514-4f8a-a574-074be003f75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.079824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-729605bd-6514-4f8a-a574-074be003f75c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:20.081077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-729605bd-6514-4f8a-a574-074be003f75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:20.099840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66e861-2b26-4869-8aca-39ab16c249a3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.139660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050facf-aa49-467c-85b0-a1d00dd0838f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.140513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050facf-aa49-467c-85b0-a1d00dd0838f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.140804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050facf-aa49-467c-85b0-a1d00dd0838f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.141083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050facf-aa49-467c-85b0-a1d00dd0838f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.141717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050facf-aa49-467c-85b0-a1d00dd0838f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:20.143144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050facf-aa49-467c-85b0-a1d00dd0838f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-a050facf-aa49-467c-85b0-a1d00dd0838f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:20.153163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:20.154755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:20.156038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 423/855] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Sep 17 00:36:19 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:20.161983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050facf-aa49-467c-85b0-a1d00dd0838f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:20.165040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 433/856] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:20.217955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:20.279816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050facf-aa49-467c-85b0-a1d00dd0838f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.314948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dc5d5-7124-4ae8-b10c-737d289b5721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.315555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dc5d5-7124-4ae8-b10c-737d289b5721 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.315832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dc5d5-7124-4ae8-b10c-737d289b5721 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.316104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dc5d5-7124-4ae8-b10c-737d289b5721 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.316731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dc5d5-7124-4ae8-b10c-737d289b5721 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:20.317031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dc5d5-7124-4ae8-b10c-737d289b5721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:20.318426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dc5d5-7124-4ae8-b10c-737d289b5721 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:20.323358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 424/857] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:20 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:20.330623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729605bd-6514-4f8a-a574-074be003f75c None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:20.431822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729605bd-6514-4f8a-a574-074be003f75c None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.442887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:20.453294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dc5d5-7124-4ae8-b10c-737d289b5721 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:20.478865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e866b-0bdb-4ed5-9791-f4c40776d61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.479996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e866b-0bdb-4ed5-9791-f4c40776d61a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.480327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e866b-0bdb-4ed5-9791-f4c40776d61a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.480601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e866b-0bdb-4ed5-9791-f4c40776d61a None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.481541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e866b-0bdb-4ed5-9791-f4c40776d61a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:20.481838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e866b-0bdb-4ed5-9791-f4c40776d61a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:20.483542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e866b-0bdb-4ed5-9791-f4c40776d61a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:20.489579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 434/858] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:20 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:20.565438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:20.572784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dc5d5-7124-4ae8-b10c-737d289b5721 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.612130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7366-52a5-4902-b3e8-88f8b54ecd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.613036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7366-52a5-4902-b3e8-88f8b54ecd3f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.613494 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7366-52a5-4902-b3e8-88f8b54ecd3f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.613914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45f7366-52a5-4902-b3e8-88f8b54ecd3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.626776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45f7366-52a5-4902-b3e8-88f8b54ecd3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-f45f7366-52a5-4902-b3e8-88f8b54ecd3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:20.632560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:20.633832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:36:20.634895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:20.637323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 425/859] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:36:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:20.645841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e866b-0bdb-4ed5-9791-f4c40776d61a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:20.760462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e866b-0bdb-4ed5-9791-f4c40776d61a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:20.797113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a08e4-8916-4beb-a802-156afefdc805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:20.797810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a08e4-8916-4beb-a802-156afefdc805 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:20.798094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a08e4-8916-4beb-a802-156afefdc805 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:20.798371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a08e4-8916-4beb-a802-156afefdc805 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:20.799042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a08e4-8916-4beb-a802-156afefdc805 None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:20.799344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a08e4-8916-4beb-a802-156afefdc805 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:20.800716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a08e4-8916-4beb-a802-156afefdc805 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:20.809527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 435/860] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:36:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:20.815072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7366-52a5-4902-b3e8-88f8b54ecd3f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.041022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45f7366-52a5-4902-b3e8-88f8b54ecd3f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:21.081044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c29c79-ca21-4974-9864-41da1b9d29f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:21.082121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29c79-ca21-4974-9864-41da1b9d29f6 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.082673 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29c79-ca21-4974-9864-41da1b9d29f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.083165 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c29c79-ca21-4974-9864-41da1b9d29f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.094634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c29c79-ca21-4974-9864-41da1b9d29f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:21.096368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c29c79-ca21-4974-9864-41da1b9d29f6 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-70c29c79-ca21-4974-9864-41da1b9d29f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:21.111510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:21.112472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:21.113385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:21.113385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:21.113385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:21.115087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 426/861] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:21.123211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a08e4-8916-4beb-a802-156afefdc805 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.136115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f55ed5-a78e-46ea-af9a-d3bd59a7fa1a None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.136401 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f55ed5-a78e-46ea-af9a-d3bd59a7fa1a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.136676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f55ed5-a78e-46ea-af9a-d3bd59a7fa1a None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.138044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 427/862] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:21.143560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee250e-a5e8-478f-837c-4253ed2cd582 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.143867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee250e-a5e8-478f-837c-4253ed2cd582 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.144114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee250e-a5e8-478f-837c-4253ed2cd582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.149952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:21.162237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8dee250e-a5e8-478f-837c-4253ed2cd582 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:21.163555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8dee250e-a5e8-478f-837c-4253ed2cd582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:21.171153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:21.236789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a08e4-8916-4beb-a802-156afefdc805 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:21.253168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 428/863] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:21.284006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ab9e5-fab2-41a1-a9fc-caa6b0ad53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:21.284621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ab9e5-fab2-41a1-a9fc-caa6b0ad53c7 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.284954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ab9e5-fab2-41a1-a9fc-caa6b0ad53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.285231 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ab9e5-fab2-41a1-a9fc-caa6b0ad53c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.285921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ab9e5-fab2-41a1-a9fc-caa6b0ad53c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:21.286222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ab9e5-fab2-41a1-a9fc-caa6b0ad53c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:21.287582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ab9e5-fab2-41a1-a9fc-caa6b0ad53c7 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:21.300792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 436/864] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:21.306267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee250e-a5e8-478f-837c-4253ed2cd582 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.408757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dee250e-a5e8-478f-837c-4253ed2cd582 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:21.443434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455059dc-d889-4241-bd7a-394299aa918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:21.444091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455059dc-d889-4241-bd7a-394299aa918e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.444365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455059dc-d889-4241-bd7a-394299aa918e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.444633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455059dc-d889-4241-bd7a-394299aa918e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.454104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455059dc-d889-4241-bd7a-394299aa918e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:21.455584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455059dc-d889-4241-bd7a-394299aa918e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:21.457685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-455059dc-d889-4241-bd7a-394299aa918e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:21.470552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:21.471567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:21.472527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 429/865] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:21 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:21.480360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ab9e5-fab2-41a1-a9fc-caa6b0ad53c7 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.557322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455059dc-d889-4241-bd7a-394299aa918e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.569742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:21.595666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ab9e5-fab2-41a1-a9fc-caa6b0ad53c7 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:21.638350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0b89-8eae-4beb-af0f-728cf961e6a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:21.638989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0b89-8eae-4beb-af0f-728cf961e6a7 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.639268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0b89-8eae-4beb-af0f-728cf961e6a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.639542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bd0b89-8eae-4beb-af0f-728cf961e6a7 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.640853 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0b89-8eae-4beb-af0f-728cf961e6a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:21.641166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0b89-8eae-4beb-af0f-728cf961e6a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:21.642932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bd0b89-8eae-4beb-af0f-728cf961e6a7 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:21.666765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 437/866] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:21.667802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0b89-8eae-4beb-af0f-728cf961e6a7 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:21.683778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455059dc-d889-4241-bd7a-394299aa918e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:21.724129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0fbc-42c2-4878-8554-eaf337d2d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:21.725059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0fbc-42c2-4878-8554-eaf337d2d376 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.725564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0fbc-42c2-4878-8554-eaf337d2d376 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.726032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fd0fbc-42c2-4878-8554-eaf337d2d376 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.726884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd0fbc-42c2-4878-8554-eaf337d2d376 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:21.728459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fd0fbc-42c2-4878-8554-eaf337d2d376 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:21.747659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 430/867] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:21 2022] POST /identity/v3/services => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:36:21.808281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bd0b89-8eae-4beb-af0f-728cf961e6a7 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:21.859836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbad398-075c-46d1-b798-0e701e3f01e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:21.860468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbad398-075c-46d1-b798-0e701e3f01e2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:21.860751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbad398-075c-46d1-b798-0e701e3f01e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:21.861023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbad398-075c-46d1-b798-0e701e3f01e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:21.864039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:21.937339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbad398-075c-46d1-b798-0e701e3f01e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:21.938883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbad398-075c-46d1-b798-0e701e3f01e2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.045486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 438/868] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:21 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:22.050662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0fbc-42c2-4878-8554-eaf337d2d376 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.113790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.166961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fd0fbc-42c2-4878-8554-eaf337d2d376 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.202585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1139868-937f-4fbb-801f-afdb51550db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.203224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1139868-937f-4fbb-801f-afdb51550db3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.203501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1139868-937f-4fbb-801f-afdb51550db3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.203770 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1139868-937f-4fbb-801f-afdb51550db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.219186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1139868-937f-4fbb-801f-afdb51550db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.220933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1139868-937f-4fbb-801f-afdb51550db3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-a1139868-937f-4fbb-801f-afdb51550db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:22.236198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:22.237143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:22.238078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:22.238078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:22.238078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:22.240145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 431/869] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:22.246074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbad398-075c-46d1-b798-0e701e3f01e2 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.281970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.356681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbad398-075c-46d1-b798-0e701e3f01e2 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.392316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165cb28-13e1-4917-9b06-b21a3bf97186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.393269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165cb28-13e1-4917-9b06-b21a3bf97186 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.393784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165cb28-13e1-4917-9b06-b21a3bf97186 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.394315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165cb28-13e1-4917-9b06-b21a3bf97186 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.395161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165cb28-13e1-4917-9b06-b21a3bf97186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:22.395665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165cb28-13e1-4917-9b06-b21a3bf97186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.397240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165cb28-13e1-4917-9b06-b21a3bf97186 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.410078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 439/870] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:22.422535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1139868-937f-4fbb-801f-afdb51550db3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.457554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946545b-2695-471d-b993-991ad1a639e3 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.457892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946545b-2695-471d-b993-991ad1a639e3 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.458178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4946545b-2695-471d-b993-991ad1a639e3 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.459813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 440/871] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:22.468199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507f90b-c857-4f8f-a93f-6a3565c6e4ad None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.468199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507f90b-c857-4f8f-a93f-6a3565c6e4ad None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.468199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507f90b-c857-4f8f-a93f-6a3565c6e4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.489328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b507f90b-c857-4f8f-a93f-6a3565c6e4ad None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:22.490888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b507f90b-c857-4f8f-a93f-6a3565c6e4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:22.560956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1139868-937f-4fbb-801f-afdb51550db3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.570822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 441/872] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:22.596004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.601994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d179ecd-50bc-42ab-ba62-fca6b75630ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.602869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d179ecd-50bc-42ab-ba62-fca6b75630ea None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.603402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d179ecd-50bc-42ab-ba62-fca6b75630ea None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.603871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d179ecd-50bc-42ab-ba62-fca6b75630ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.610872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d179ecd-50bc-42ab-ba62-fca6b75630ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.612538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d179ecd-50bc-42ab-ba62-fca6b75630ea None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-0d179ecd-50bc-42ab-ba62-fca6b75630ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:22.625015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:22.626044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:22.627003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:22.627003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:22.627003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:22.627003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:22.627003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:22.627003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:22.627003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:22.627003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:22.629013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 432/873] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:22.634883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507f90b-c857-4f8f-a93f-6a3565c6e4ad None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.660874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.745378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b507f90b-c857-4f8f-a93f-6a3565c6e4ad None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.785010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087b959-d2df-4477-a174-08f0a70e9825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.785667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087b959-d2df-4477-a174-08f0a70e9825 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.785949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087b959-d2df-4477-a174-08f0a70e9825 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.786220 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087b959-d2df-4477-a174-08f0a70e9825 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.786922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087b959-d2df-4477-a174-08f0a70e9825 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:22.787226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087b959-d2df-4477-a174-08f0a70e9825 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.788659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7087b959-d2df-4477-a174-08f0a70e9825 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.802265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 442/874] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:22.808052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d179ecd-50bc-42ab-ba62-fca6b75630ea None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.819386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d2396-2632-49fc-854c-768f44e4f4d9 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.819676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d2396-2632-49fc-854c-768f44e4f4d9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.819955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d2396-2632-49fc-854c-768f44e4f4d9 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.821679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 443/875] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:22.826395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b6954-a74e-4ed2-a720-453fbb69b7f6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.826745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b6954-a74e-4ed2-a720-453fbb69b7f6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.827030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b6954-a74e-4ed2-a720-453fbb69b7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.845945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d68b6954-a74e-4ed2-a720-453fbb69b7f6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:22.847259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d68b6954-a74e-4ed2-a720-453fbb69b7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:22.923012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d179ecd-50bc-42ab-ba62-fca6b75630ea None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:22.924888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 444/876] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:22 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:22.925680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b6954-a74e-4ed2-a720-453fbb69b7f6 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:22.943556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:22.973967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30853483-6d28-4d52-af8e-296d36c23449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:22.974937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30853483-6d28-4d52-af8e-296d36c23449 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:22.975795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30853483-6d28-4d52-af8e-296d36c23449 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:22.976256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30853483-6d28-4d52-af8e-296d36c23449 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:22.977600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30853483-6d28-4d52-af8e-296d36c23449 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=e639d502dd3c46199da050a0f71de561) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:22.978334 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30853483-6d28-4d52-af8e-296d36c23449 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:22.980692 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30853483-6d28-4d52-af8e-296d36c23449 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:22.993968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 433/877] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/role_assignments?user.id=e639d502dd3c46199da050a0f71de561&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:23.051005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b6954-a74e-4ed2-a720-453fbb69b7f6 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.089832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f6fe9-3c09-4726-ab73-7e3691fccab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:23.090488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6fe9-3c09-4726-ab73-7e3691fccab8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.090765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6fe9-3c09-4726-ab73-7e3691fccab8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.091036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8f6fe9-3c09-4726-ab73-7e3691fccab8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.092237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f6fe9-3c09-4726-ab73-7e3691fccab8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.093638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8f6fe9-3c09-4726-ab73-7e3691fccab8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-8b8f6fe9-3c09-4726-ab73-7e3691fccab8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:23.103515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:23.104595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:23.105480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 445/878] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:23.110901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30853483-6d28-4d52-af8e-296d36c23449 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.148327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:23.197631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f6fe9-3c09-4726-ab73-7e3691fccab8 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.230820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30853483-6d28-4d52-af8e-296d36c23449 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.270497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135079-5b09-4c93-a13f-99eb7386cf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:23.271110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135079-5b09-4c93-a13f-99eb7386cf9b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.271393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135079-5b09-4c93-a13f-99eb7386cf9b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.271915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89135079-5b09-4c93-a13f-99eb7386cf9b None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.272297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135079-5b09-4c93-a13f-99eb7386cf9b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:23.272607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135079-5b09-4c93-a13f-99eb7386cf9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.274020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89135079-5b09-4c93-a13f-99eb7386cf9b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.280125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 434/879] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:23.285951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135079-5b09-4c93-a13f-99eb7386cf9b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:23.295123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:23.320039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8f6fe9-3c09-4726-ab73-7e3691fccab8 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.364574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e9224d-a83f-4bee-9b47-78dc6de27962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:23.364574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9224d-a83f-4bee-9b47-78dc6de27962 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.364574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9224d-a83f-4bee-9b47-78dc6de27962 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.364574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e9224d-a83f-4bee-9b47-78dc6de27962 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.365061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9224d-a83f-4bee-9b47-78dc6de27962 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.365781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e9224d-a83f-4bee-9b47-78dc6de27962 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.384557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 446/880] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:23 2022] POST /identity/v3/services => generated 269 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:36:23.409164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:23.413973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89135079-5b09-4c93-a13f-99eb7386cf9b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:23.469287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc381d2-34b1-47dd-862b-43114ddc4c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:23.470197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc381d2-34b1-47dd-862b-43114ddc4c95 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:23.470641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc381d2-34b1-47dd-862b-43114ddc4c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:23.471090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc381d2-34b1-47dd-862b-43114ddc4c95 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:23.471894 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc381d2-34b1-47dd-862b-43114ddc4c95 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:23.472360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc381d2-34b1-47dd-862b-43114ddc4c95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:23.473956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc381d2-34b1-47dd-862b-43114ddc4c95 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:23.479826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 435/881] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:24.040023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99be22-1cac-412d-9cf6-23c6a951a26f None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.040385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99be22-1cac-412d-9cf6-23c6a951a26f None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.040576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99be22-1cac-412d-9cf6-23c6a951a26f None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.042211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 447/882] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:24.047349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b63b-93d4-4904-a97e-152e1cc8d463 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.047785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b63b-93d4-4904-a97e-152e1cc8d463 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.047883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b63b-93d4-4904-a97e-152e1cc8d463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.066353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7608b63b-93d4-4904-a97e-152e1cc8d463 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:24.067522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7608b63b-93d4-4904-a97e-152e1cc8d463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:24.139631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 436/883] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:24.410687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99be22-1cac-412d-9cf6-23c6a951a26f None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:24.527815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99be22-1cac-412d-9cf6-23c6a951a26f None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:24.561741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731be37b-926e-47ba-ab0d-8d33d6eba1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:24.562368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731be37b-926e-47ba-ab0d-8d33d6eba1d2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.562661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731be37b-926e-47ba-ab0d-8d33d6eba1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.562918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731be37b-926e-47ba-ab0d-8d33d6eba1d2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.563499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731be37b-926e-47ba-ab0d-8d33d6eba1d2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:24.564843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731be37b-926e-47ba-ab0d-8d33d6eba1d2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-731be37b-926e-47ba-ab0d-8d33d6eba1d2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:24.573530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:24.574507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:24.575337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 448/884] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:24.583186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b63b-93d4-4904-a97e-152e1cc8d463 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:24.671262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:24.684286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b63b-93d4-4904-a97e-152e1cc8d463 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:24.719797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026296ea-b50e-4f4d-aa0c-43171d4cbe9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:24.720791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026296ea-b50e-4f4d-aa0c-43171d4cbe9d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.721276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026296ea-b50e-4f4d-aa0c-43171d4cbe9d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.721766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026296ea-b50e-4f4d-aa0c-43171d4cbe9d None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.722581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026296ea-b50e-4f4d-aa0c-43171d4cbe9d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:24.723093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026296ea-b50e-4f4d-aa0c-43171d4cbe9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:24.724639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026296ea-b50e-4f4d-aa0c-43171d4cbe9d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:24.730067 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 437/885] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:24.735943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731be37b-926e-47ba-ab0d-8d33d6eba1d2 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:24.740479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:24.842103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731be37b-926e-47ba-ab0d-8d33d6eba1d2 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:24.876242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e853f-1132-4f7d-9cf6-c35482c6471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:24.876846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e853f-1132-4f7d-9cf6-c35482c6471c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:24.877121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e853f-1132-4f7d-9cf6-c35482c6471c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:24.877391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e853f-1132-4f7d-9cf6-c35482c6471c None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:24.878047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e853f-1132-4f7d-9cf6-c35482c6471c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:24.878345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e853f-1132-4f7d-9cf6-c35482c6471c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:24.879763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e853f-1132-4f7d-9cf6-c35482c6471c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:24.885033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 449/886] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:24.890919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026296ea-b50e-4f4d-aa0c-43171d4cbe9d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:24.990569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026296ea-b50e-4f4d-aa0c-43171d4cbe9d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:25.025018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4e4e4-3000-48f6-95c6-de3dbf209654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:25.025657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4e4e4-3000-48f6-95c6-de3dbf209654 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.025930 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4e4e4-3000-48f6-95c6-de3dbf209654 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.026199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4e4e4-3000-48f6-95c6-de3dbf209654 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.026947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4e4e4-3000-48f6-95c6-de3dbf209654 None admin] RBAC: Adding query filter params (interface=public, service_id=e9764d54b72d47c2a9e7319ade46e331, region_id=RegionOne) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:25.027249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4e4e4-3000-48f6-95c6-de3dbf209654 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:25.028665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4e4e4-3000-48f6-95c6-de3dbf209654 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:25.033950 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 438/887] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:24 2022] GET /identity/v3/endpoints?service_id=e9764d54b72d47c2a9e7319ade46e331&interface=public®ion_id=RegionOne => generated 194 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:25.039506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e853f-1132-4f7d-9cf6-c35482c6471c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:25.107649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:25.144235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e853f-1132-4f7d-9cf6-c35482c6471c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:25.179301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fded13a-27ac-4b0d-9f18-59fa9d9b2797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:25.179916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fded13a-27ac-4b0d-9f18-59fa9d9b2797 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.180189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fded13a-27ac-4b0d-9f18-59fa9d9b2797 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.180459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fded13a-27ac-4b0d-9f18-59fa9d9b2797 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.181145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fded13a-27ac-4b0d-9f18-59fa9d9b2797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:25.182651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fded13a-27ac-4b0d-9f18-59fa9d9b2797 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:25.188998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 450/888] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:25 2022] GET /identity/v3/services => generated 1268 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:36:25.446397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48ddb2-21de-4a04-bb05-5266509b1cf8 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.446933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48ddb2-21de-4a04-bb05-5266509b1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.446933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc48ddb2-21de-4a04-bb05-5266509b1cf8 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.448573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 439/889] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:25.457220 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a6b9-ebf9-4210-8c34-ef3e64578c3a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.457220 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a6b9-ebf9-4210-8c34-ef3e64578c3a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.457220 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db15a6b9-ebf9-4210-8c34-ef3e64578c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.474422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-db15a6b9-ebf9-4210-8c34-ef3e64578c3a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:25.475940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-db15a6b9-ebf9-4210-8c34-ef3e64578c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:25.550720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 451/890] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:25.671621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa68e-1592-4194-8736-b5d1483d7e12 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.671820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa68e-1592-4194-8736-b5d1483d7e12 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.672084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1aa68e-1592-4194-8736-b5d1483d7e12 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.673715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 440/891] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:25.678949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e657f0-8b38-4154-b37b-d3f1190cd356 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.679240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e657f0-8b38-4154-b37b-d3f1190cd356 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.679516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e657f0-8b38-4154-b37b-d3f1190cd356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.698255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-54e657f0-8b38-4154-b37b-d3f1190cd356 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:25.699434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-54e657f0-8b38-4154-b37b-d3f1190cd356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:25.744712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd36b06-599f-4d26-aae9-d2ac56847a95 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.745054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd36b06-599f-4d26-aae9-d2ac56847a95 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.745304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd36b06-599f-4d26-aae9-d2ac56847a95 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.746982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 441/892] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:25.752564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2982a-1710-4ece-bee7-7229b77c229f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.752848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2982a-1710-4ece-bee7-7229b77c229f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.753122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2982a-1710-4ece-bee7-7229b77c229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.757942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:25.771245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 452/893] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:25.772454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-dda2982a-1710-4ece-bee7-7229b77c229f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:25.773695 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-dda2982a-1710-4ece-bee7-7229b77c229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:25.787558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:25.828768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e657f0-8b38-4154-b37b-d3f1190cd356 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:25.850091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 442/894] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:25.933229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e657f0-8b38-4154-b37b-d3f1190cd356 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:25.967458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ee4c1-5104-40e9-9651-9ee7e712ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:25.968097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ee4c1-5104-40e9-9651-9ee7e712ac3b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:25.968371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ee4c1-5104-40e9-9651-9ee7e712ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:25.968638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ee4c1-5104-40e9-9651-9ee7e712ac3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:25.980531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ee4c1-5104-40e9-9651-9ee7e712ac3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-7f9ee4c1-5104-40e9-9651-9ee7e712ac3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:25.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:25.987629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:25.988526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 453/895] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:25.993363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2982a-1710-4ece-bee7-7229b77c229f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.041906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ee4c1-5104-40e9-9651-9ee7e712ac3b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.101393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:26.106298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2982a-1710-4ece-bee7-7229b77c229f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.147544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dadc09-7bd8-45d3-9755-3a0eb3486cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.148167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadc09-7bd8-45d3-9755-3a0eb3486cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.148443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadc09-7bd8-45d3-9755-3a0eb3486cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.148715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadc09-7bd8-45d3-9755-3a0eb3486cf0 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.149420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadc09-7bd8-45d3-9755-3a0eb3486cf0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:26.149743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadc09-7bd8-45d3-9755-3a0eb3486cf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.151153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadc09-7bd8-45d3-9755-3a0eb3486cf0 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:26.160580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 443/896] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:26.161860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dadc09-7bd8-45d3-9755-3a0eb3486cf0 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.164773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ee4c1-5104-40e9-9651-9ee7e712ac3b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.178510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:26.204972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f5006-05cc-4d1c-bfd9-f8905180902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.205546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f5006-05cc-4d1c-bfd9-f8905180902d None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.205837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f5006-05cc-4d1c-bfd9-f8905180902d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.206091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2f5006-05cc-4d1c-bfd9-f8905180902d None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.206760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f5006-05cc-4d1c-bfd9-f8905180902d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.208118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2f5006-05cc-4d1c-bfd9-f8905180902d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:26.224962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 454/897] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:26 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:36:26.226748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f5006-05cc-4d1c-bfd9-f8905180902d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.294536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dadc09-7bd8-45d3-9755-3a0eb3486cf0 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.351366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7595e9a-d0ca-4754-b724-67ac40ed270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.352178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7595e9a-d0ca-4754-b724-67ac40ed270f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.352329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7595e9a-d0ca-4754-b724-67ac40ed270f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.352542 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7595e9a-d0ca-4754-b724-67ac40ed270f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.353319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7595e9a-d0ca-4754-b724-67ac40ed270f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.354806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7595e9a-d0ca-4754-b724-67ac40ed270f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:26.356720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2f5006-05cc-4d1c-bfd9-f8905180902d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-e7595e9a-d0ca-4754-b724-67ac40ed270f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:26.365014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:26.366101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:26.366985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 444/898] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:26.372317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7595e9a-d0ca-4754-b724-67ac40ed270f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.374498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:26.411335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2619c-1919-4dbc-bf0a-e067b3f52a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.412242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2619c-1919-4dbc-bf0a-e067b3f52a84 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.413271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2619c-1919-4dbc-bf0a-e067b3f52a84 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.413722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c2619c-1919-4dbc-bf0a-e067b3f52a84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.429739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2619c-1919-4dbc-bf0a-e067b3f52a84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.431204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c2619c-1919-4dbc-bf0a-e067b3f52a84 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-b9c2619c-1919-4dbc-bf0a-e067b3f52a84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:26.451101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:26.452110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:26.452995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:26.452995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:26.452995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:26.452995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 455/899] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:26.459203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2619c-1919-4dbc-bf0a-e067b3f52a84 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.474479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:26.520921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7595e9a-d0ca-4754-b724-67ac40ed270f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.566405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9a67-890c-4351-a4b8-d74b421277df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.567026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9a67-890c-4351-a4b8-d74b421277df None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.567218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c2619c-1919-4dbc-bf0a-e067b3f52a84 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.567321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9a67-890c-4351-a4b8-d74b421277df None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.567558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0b9a67-890c-4351-a4b8-d74b421277df None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.568192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b9a67-890c-4351-a4b8-d74b421277df None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:26.568493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b9a67-890c-4351-a4b8-d74b421277df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.570076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0b9a67-890c-4351-a4b8-d74b421277df None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:26.577206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 445/900] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:26.582488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9a67-890c-4351-a4b8-d74b421277df None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.608061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc58d7-a583-4fb2-b084-6d7fe94194a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.608740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc58d7-a583-4fb2-b084-6d7fe94194a5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.609003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc58d7-a583-4fb2-b084-6d7fe94194a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.609274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc58d7-a583-4fb2-b084-6d7fe94194a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.609950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc58d7-a583-4fb2-b084-6d7fe94194a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:26.610252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc58d7-a583-4fb2-b084-6d7fe94194a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.611605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc58d7-a583-4fb2-b084-6d7fe94194a5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:26.628273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 456/901] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:26.629624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc58d7-a583-4fb2-b084-6d7fe94194a5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.656237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:26.696394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0b9a67-890c-4351-a4b8-d74b421277df None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.727268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:26.733945 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8f84-cae0-4ad9-bb88-b9ee7ba5b7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.734857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8f84-cae0-4ad9-bb88-b9ee7ba5b7fb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.735142 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8f84-cae0-4ad9-bb88-b9ee7ba5b7fb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.735419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf8f84-cae0-4ad9-bb88-b9ee7ba5b7fb None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.736058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8f84-cae0-4ad9-bb88-b9ee7ba5b7fb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:26.736364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8f84-cae0-4ad9-bb88-b9ee7ba5b7fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.737839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf8f84-cae0-4ad9-bb88-b9ee7ba5b7fb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:26.745466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 446/902] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:26.751079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8f84-cae0-4ad9-bb88-b9ee7ba5b7fb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.756833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc58d7-a583-4fb2-b084-6d7fe94194a5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.797922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f782d-4d1e-4a0a-a513-8b32f10a8026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.798264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f782d-4d1e-4a0a-a513-8b32f10a8026 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.798551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f782d-4d1e-4a0a-a513-8b32f10a8026 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.798825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f782d-4d1e-4a0a-a513-8b32f10a8026 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.806337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f782d-4d1e-4a0a-a513-8b32f10a8026 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.807903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f782d-4d1e-4a0a-a513-8b32f10a8026 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-879f782d-4d1e-4a0a-a513-8b32f10a8026 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:26.821334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:26.822374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:26.823329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:26.827926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 457/903] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:26.829749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f782d-4d1e-4a0a-a513-8b32f10a8026 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.886758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf8f84-cae0-4ad9-bb88-b9ee7ba5b7fb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.927907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:26.942002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0e63e-ca30-41c9-b95f-f24875a10815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.943550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0e63e-ca30-41c9-b95f-f24875a10815 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.944204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0e63e-ca30-41c9-b95f-f24875a10815 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.944804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d0e63e-ca30-41c9-b95f-f24875a10815 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.946011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0e63e-ca30-41c9-b95f-f24875a10815 None admin] RBAC: Adding query filter params (interface=public, service_id=4b78f1712d8644448674f912ef5f1fe1, region_id=RegionOne) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:26.946895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0e63e-ca30-41c9-b95f-f24875a10815 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.948845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d0e63e-ca30-41c9-b95f-f24875a10815 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:26.949187 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f782d-4d1e-4a0a-a513-8b32f10a8026 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:26.956355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 447/904] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/endpoints?service_id=4b78f1712d8644448674f912ef5f1fe1&interface=public®ion_id=RegionOne => generated 194 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:26.963291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0e63e-ca30-41c9-b95f-f24875a10815 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:26.992920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac2fb8-f653-4497-bff5-e3b0d6a2563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:26.993480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac2fb8-f653-4497-bff5-e3b0d6a2563d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:26.993766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac2fb8-f653-4497-bff5-e3b0d6a2563d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:26.994039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ac2fb8-f653-4497-bff5-e3b0d6a2563d None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:26.994783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac2fb8-f653-4497-bff5-e3b0d6a2563d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:26.995088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac2fb8-f653-4497-bff5-e3b0d6a2563d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:26.996550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ac2fb8-f653-4497-bff5-e3b0d6a2563d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.022702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 458/905] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:27.024139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac2fb8-f653-4497-bff5-e3b0d6a2563d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.045603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.097562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d0e63e-ca30-41c9-b95f-f24875a10815 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.133315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3e39f-5954-4eba-9a7c-6f24c3206ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.134039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3e39f-5954-4eba-9a7c-6f24c3206ad5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.134357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3e39f-5954-4eba-9a7c-6f24c3206ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.134642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3e39f-5954-4eba-9a7c-6f24c3206ad5 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.135245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3e39f-5954-4eba-9a7c-6f24c3206ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.136609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab3e39f-5954-4eba-9a7c-6f24c3206ad5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.149437 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 448/906] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:26 2022] GET /identity/v3/services => generated 1497 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:36:27.159962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ac2fb8-f653-4497-bff5-e3b0d6a2563d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.200390 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbab0f9-ecfc-47cf-9491-55f4521eafd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.201090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbab0f9-ecfc-47cf-9491-55f4521eafd5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.201369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbab0f9-ecfc-47cf-9491-55f4521eafd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.201678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbab0f9-ecfc-47cf-9491-55f4521eafd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.214504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.279530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbab0f9-ecfc-47cf-9491-55f4521eafd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.281064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbab0f9-ecfc-47cf-9491-55f4521eafd5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.402512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 459/907] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:27.410984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3e39f-5954-4eba-9a7c-6f24c3206ad5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.442015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26080-8cbe-4bb9-aa40-452df2d4bbc7 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.442339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26080-8cbe-4bb9-aa40-452df2d4bbc7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.442571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc26080-8cbe-4bb9-aa40-452df2d4bbc7 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.444710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 460/908] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:27.449944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf743b8-9b7c-4713-b5da-438888ec8a47 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.450234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf743b8-9b7c-4713-b5da-438888ec8a47 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.450515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf743b8-9b7c-4713-b5da-438888ec8a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.469441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0bf743b8-9b7c-4713-b5da-438888ec8a47 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:27.470633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0bf743b8-9b7c-4713-b5da-438888ec8a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:27.507685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.529262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab3e39f-5954-4eba-9a7c-6f24c3206ad5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.549599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 461/909] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:27.556094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.568363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aca82-3d40-472d-927b-a5d6bb09c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.569280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aca82-3d40-472d-927b-a5d6bb09c645 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.569803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aca82-3d40-472d-927b-a5d6bb09c645 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.570367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59aca82-3d40-472d-927b-a5d6bb09c645 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.581770 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aca82-3d40-472d-927b-a5d6bb09c645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.583516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59aca82-3d40-472d-927b-a5d6bb09c645 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-d59aca82-3d40-472d-927b-a5d6bb09c645 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:27.599024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:27.599999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:27.600915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:27.600915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:27.600915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:27.603000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 449/910] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:27.611135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf743b8-9b7c-4713-b5da-438888ec8a47 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.711723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf743b8-9b7c-4713-b5da-438888ec8a47 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.747520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dbe91-0f62-4d9f-bf44-0407c1bc3c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.748133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dbe91-0f62-4d9f-bf44-0407c1bc3c94 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.748409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dbe91-0f62-4d9f-bf44-0407c1bc3c94 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.748680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dbe91-0f62-4d9f-bf44-0407c1bc3c94 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.749324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dbe91-0f62-4d9f-bf44-0407c1bc3c94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:27.749657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dbe91-0f62-4d9f-bf44-0407c1bc3c94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.751116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767dbe91-0f62-4d9f-bf44-0407c1bc3c94 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.766955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 462/911] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:27.768332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aca82-3d40-472d-927b-a5d6bb09c645 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.841817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dbe91-0f62-4d9f-bf44-0407c1bc3c94 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.877637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59aca82-3d40-472d-927b-a5d6bb09c645 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.878412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:27.917922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844e4f-b8d7-44a3-82e9-a214dbd10aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:27.919123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844e4f-b8d7-44a3-82e9-a214dbd10aaa None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:27.919723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844e4f-b8d7-44a3-82e9-a214dbd10aaa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:27.920205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb844e4f-b8d7-44a3-82e9-a214dbd10aaa None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:27.927804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb844e4f-b8d7-44a3-82e9-a214dbd10aaa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:27.929840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb844e4f-b8d7-44a3-82e9-a214dbd10aaa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-fb844e4f-b8d7-44a3-82e9-a214dbd10aaa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:27.943753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:27.944784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:27.945706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:27.945706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:27.945706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:27.945706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:27.945706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:27.945706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:27.945706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:27.945706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:27.948129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 450/912] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:27.955067 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844e4f-b8d7-44a3-82e9-a214dbd10aaa None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:27.961073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dbe91-0f62-4d9f-bf44-0407c1bc3c94 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:27.999818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.003814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161cf29-d862-4eb3-9373-414ec81398cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.004742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161cf29-d862-4eb3-9373-414ec81398cb None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.005293 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161cf29-d862-4eb3-9373-414ec81398cb None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.005805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161cf29-d862-4eb3-9373-414ec81398cb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.007075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161cf29-d862-4eb3-9373-414ec81398cb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.009038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161cf29-d862-4eb3-9373-414ec81398cb None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-9161cf29-d862-4eb3-9373-414ec81398cb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:28.020906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:28.022011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 17 00:36:28.022864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:28.030656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 463/913] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:28.031475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161cf29-d862-4eb3-9373-414ec81398cb None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.081574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb844e4f-b8d7-44a3-82e9-a214dbd10aaa None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.120978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d4468-7c7f-4168-a36d-ec965247e278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.122026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d4468-7c7f-4168-a36d-ec965247e278 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.122612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d4468-7c7f-4168-a36d-ec965247e278 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.123095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d4468-7c7f-4168-a36d-ec965247e278 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.124139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d4468-7c7f-4168-a36d-ec965247e278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:28.124659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d4468-7c7f-4168-a36d-ec965247e278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.126531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d4468-7c7f-4168-a36d-ec965247e278 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.141080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 451/914] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:28.146978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d4468-7c7f-4168-a36d-ec965247e278 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.152364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.162116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161cf29-d862-4eb3-9373-414ec81398cb None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.202744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c98a41-d6a7-415c-960e-077321ce445a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.203419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c98a41-d6a7-415c-960e-077321ce445a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.203706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c98a41-d6a7-415c-960e-077321ce445a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.203984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c98a41-d6a7-415c-960e-077321ce445a None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.204677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c98a41-d6a7-415c-960e-077321ce445a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:28.205036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c98a41-d6a7-415c-960e-077321ce445a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.206868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c98a41-d6a7-415c-960e-077321ce445a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.217596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 464/915] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:28.219812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c98a41-d6a7-415c-960e-077321ce445a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.276575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.284429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d4468-7c7f-4168-a36d-ec965247e278 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.332966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1501ec-36db-4e9f-af9b-af63799afafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.333633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1501ec-36db-4e9f-af9b-af63799afafa None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.334211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1501ec-36db-4e9f-af9b-af63799afafa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.334493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1501ec-36db-4e9f-af9b-af63799afafa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.335253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1501ec-36db-4e9f-af9b-af63799afafa None admin] RBAC: Adding query filter params (role.id=15a4044f85c94d1eb8032a1fd3c5ed13, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=e639d502dd3c46199da050a0f71de561) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:28.335564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1501ec-36db-4e9f-af9b-af63799afafa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.337783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1501ec-36db-4e9f-af9b-af63799afafa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.351328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c98a41-d6a7-415c-960e-077321ce445a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.353513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 452/916] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/role_assignments?user.id=e639d502dd3c46199da050a0f71de561&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=15a4044f85c94d1eb8032a1fd3c5ed13 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:28.390981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db10b004-4c11-4156-bcea-6f1d0cf2b956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.391983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10b004-4c11-4156-bcea-6f1d0cf2b956 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.392479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10b004-4c11-4156-bcea-6f1d0cf2b956 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.392953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db10b004-4c11-4156-bcea-6f1d0cf2b956 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.393939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10b004-4c11-4156-bcea-6f1d0cf2b956 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:28.394457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10b004-4c11-4156-bcea-6f1d0cf2b956 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.396122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db10b004-4c11-4156-bcea-6f1d0cf2b956 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.402426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 465/917] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:28.409041 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1501ec-36db-4e9f-af9b-af63799afafa None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.462769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff5f8-b70e-40ca-9186-4d98521e4dd3 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.463693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff5f8-b70e-40ca-9186-4d98521e4dd3 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.464201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ff5f8-b70e-40ca-9186-4d98521e4dd3 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.466145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 466/918] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:28.472568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6b2e0-b1b4-4940-bf8d-8cd71fa09465 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.473646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6b2e0-b1b4-4940-bf8d-8cd71fa09465 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.474140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb6b2e0-b1b4-4940-bf8d-8cd71fa09465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.494349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8fb6b2e0-b1b4-4940-bf8d-8cd71fa09465 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:28.496132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8fb6b2e0-b1b4-4940-bf8d-8cd71fa09465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:28.516518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:28.540856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1501ec-36db-4e9f-af9b-af63799afafa None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:28.578841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 467/919] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:28.582228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e2bd4-0e94-4299-a9ba-d5f830b2d5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:28.582843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e2bd4-0e94-4299-a9ba-d5f830b2d5f8 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:28.583124 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e2bd4-0e94-4299-a9ba-d5f830b2d5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:28.583396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e2bd4-0e94-4299-a9ba-d5f830b2d5f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:28.584068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e2bd4-0e94-4299-a9ba-d5f830b2d5f8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:28.589446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605e2bd4-0e94-4299-a9ba-d5f830b2d5f8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:28.611781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 453/920] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:28.860046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6b2e0-b1b4-4940-bf8d-8cd71fa09465 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:28.965054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb6b2e0-b1b4-4940-bf8d-8cd71fa09465 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.008090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e468b-5240-4516-a3a1-9ac3ed59b24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.008733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e468b-5240-4516-a3a1-9ac3ed59b24c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.009007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e468b-5240-4516-a3a1-9ac3ed59b24c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.009272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e468b-5240-4516-a3a1-9ac3ed59b24c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.009882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e468b-5240-4516-a3a1-9ac3ed59b24c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.011233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8e468b-5240-4516-a3a1-9ac3ed59b24c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-fe8e468b-5240-4516-a3a1-9ac3ed59b24c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:29.020926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:29.021903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:29.022940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 468/921] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:29.030247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e2bd4-0e94-4299-a9ba-d5f830b2d5f8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.058264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:29.137933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e2bd4-0e94-4299-a9ba-d5f830b2d5f8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.173273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b9895-fc38-4028-bc34-2492e92edd5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.173914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b9895-fc38-4028-bc34-2492e92edd5c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.174203 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b9895-fc38-4028-bc34-2492e92edd5c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.174481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920b9895-fc38-4028-bc34-2492e92edd5c None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.175119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b9895-fc38-4028-bc34-2492e92edd5c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:29.175426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b9895-fc38-4028-bc34-2492e92edd5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.176796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920b9895-fc38-4028-bc34-2492e92edd5c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.182212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 454/922] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:29.188417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e468b-5240-4516-a3a1-9ac3ed59b24c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.206221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:29.300454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e468b-5240-4516-a3a1-9ac3ed59b24c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.338937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c754d-6e60-41fb-bc1b-d04cd618f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.339793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c754d-6e60-41fb-bc1b-d04cd618f203 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.340314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c754d-6e60-41fb-bc1b-d04cd618f203 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.340726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c754d-6e60-41fb-bc1b-d04cd618f203 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.342055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c754d-6e60-41fb-bc1b-d04cd618f203 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:29.342512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c754d-6e60-41fb-bc1b-d04cd618f203 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.344080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c754d-6e60-41fb-bc1b-d04cd618f203 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.349611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 469/923] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:29.357608 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b9895-fc38-4028-bc34-2492e92edd5c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.404294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830fb3-090f-4d2f-aabb-c428cb400b25 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.404483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830fb3-090f-4d2f-aabb-c428cb400b25 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.404753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f830fb3-090f-4d2f-aabb-c428cb400b25 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.406961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 470/924] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:29.420275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e47552-902b-4b50-a86d-55fba2f9dd50 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.421062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e47552-902b-4b50-a86d-55fba2f9dd50 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.421589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e47552-902b-4b50-a86d-55fba2f9dd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.445767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c8e47552-902b-4b50-a86d-55fba2f9dd50 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:29.447416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c8e47552-902b-4b50-a86d-55fba2f9dd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:29.455156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:29.480698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920b9895-fc38-4028-bc34-2492e92edd5c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.524239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf22d0-5c27-4b81-af9a-850f870dcb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.524851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf22d0-5c27-4b81-af9a-850f870dcb5f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.525128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf22d0-5c27-4b81-af9a-850f870dcb5f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.525397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf22d0-5c27-4b81-af9a-850f870dcb5f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.526675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf22d0-5c27-4b81-af9a-850f870dcb5f None admin] RBAC: Adding query filter params (interface=public, service_id=d73a3f36fcb5494396a0934507e64d28, region_id=RegionOne) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:29.527132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf22d0-5c27-4b81-af9a-850f870dcb5f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.528611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf22d0-5c27-4b81-af9a-850f870dcb5f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.533523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 471/925] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:29.542964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 455/926] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/endpoints?service_id=d73a3f36fcb5494396a0934507e64d28&interface=public®ion_id=RegionOne => generated 194 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:29.545470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e47552-902b-4b50-a86d-55fba2f9dd50 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.554923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:29.653738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e47552-902b-4b50-a86d-55fba2f9dd50 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.692660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fdcd2-d1b9-41fe-98cf-0a6809297ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.693186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fdcd2-d1b9-41fe-98cf-0a6809297ef3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.693495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fdcd2-d1b9-41fe-98cf-0a6809297ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.693766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1fdcd2-d1b9-41fe-98cf-0a6809297ef3 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.694368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fdcd2-d1b9-41fe-98cf-0a6809297ef3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.695722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1fdcd2-d1b9-41fe-98cf-0a6809297ef3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.702486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 472/927] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:36:29.831612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf22d0-5c27-4b81-af9a-850f870dcb5f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:29.948239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf22d0-5c27-4b81-af9a-850f870dcb5f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:29.984448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb8268-edab-465d-b0db-294aec4faf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:29.985463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb8268-edab-465d-b0db-294aec4faf01 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:29.985968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb8268-edab-465d-b0db-294aec4faf01 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:29.986441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb8268-edab-465d-b0db-294aec4faf01 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:29.987187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb8268-edab-465d-b0db-294aec4faf01 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:29.988869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb8268-edab-465d-b0db-294aec4faf01 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-3dcb8268-edab-465d-b0db-294aec4faf01 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:29.999141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:30.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 17 00:36:30.001000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:30.003781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 456/928] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Sep 17 00:36:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:30.009388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fdcd2-d1b9-41fe-98cf-0a6809297ef3 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:30.080355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:30.115587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1fdcd2-d1b9-41fe-98cf-0a6809297ef3 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:30.150582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7c0bc-c50e-4b29-b817-087c61b5def3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:30.151193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7c0bc-c50e-4b29-b817-087c61b5def3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.151469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7c0bc-c50e-4b29-b817-087c61b5def3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.151740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7c0bc-c50e-4b29-b817-087c61b5def3 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.152366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7c0bc-c50e-4b29-b817-087c61b5def3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:30.152662 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7c0bc-c50e-4b29-b817-087c61b5def3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:30.154939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7c0bc-c50e-4b29-b817-087c61b5def3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:30.160261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 473/929] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:30.165838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb8268-edab-465d-b0db-294aec4faf01 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:30.182229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:30.284523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb8268-edab-465d-b0db-294aec4faf01 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:30.320616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf43d8ab-199a-4594-8e3a-7efe058f83c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:30.321504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d8ab-199a-4594-8e3a-7efe058f83c9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.321930 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d8ab-199a-4594-8e3a-7efe058f83c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.322443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf43d8ab-199a-4594-8e3a-7efe058f83c9 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.323220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43d8ab-199a-4594-8e3a-7efe058f83c9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:30.323691 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43d8ab-199a-4594-8e3a-7efe058f83c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:30.325202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf43d8ab-199a-4594-8e3a-7efe058f83c9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:30.331499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 457/930] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:30.336821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7c0bc-c50e-4b29-b817-087c61b5def3 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:30.441770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7c0bc-c50e-4b29-b817-087c61b5def3 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:30.480679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1454ab-4741-4e0f-8262-0c862f4b556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:30.481296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1454ab-4741-4e0f-8262-0c862f4b556f None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.481606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1454ab-4741-4e0f-8262-0c862f4b556f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.482403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1454ab-4741-4e0f-8262-0c862f4b556f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.483089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1454ab-4741-4e0f-8262-0c862f4b556f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:30.484458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1454ab-4741-4e0f-8262-0c862f4b556f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:30.489246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:30.516999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 474/931] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:30.634089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1407e-126a-410b-a1a1-9624c045227f None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.634582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1407e-126a-410b-a1a1-9624c045227f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.634582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1407e-126a-410b-a1a1-9624c045227f None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.636137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 458/932] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:30.642236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb184-36fe-48ca-aa44-5f7a5d7bd16b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.642744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb184-36fe-48ca-aa44-5f7a5d7bd16b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.642824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbcb184-36fe-48ca-aa44-5f7a5d7bd16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.663103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-dfbcb184-36fe-48ca-aa44-5f7a5d7bd16b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:30.664359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-dfbcb184-36fe-48ca-aa44-5f7a5d7bd16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:30.745033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 475/933] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:30.871043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176763d6-ab35-41f2-acbc-c450b8896ce2 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.871402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176763d6-ab35-41f2-acbc-c450b8896ce2 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.871609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176763d6-ab35-41f2-acbc-c450b8896ce2 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.873749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 459/934] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:30.878990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143b3c9-1502-40fb-bade-927659f31d74 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:30.879278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143b3c9-1502-40fb-bade-927659f31d74 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:30.879545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8143b3c9-1502-40fb-bade-927659f31d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:30.897980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8143b3c9-1502-40fb-bade-927659f31d74 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:30.899072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8143b3c9-1502-40fb-bade-927659f31d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:30.967903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 476/935] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:31.021962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176763d6-ab35-41f2-acbc-c450b8896ce2 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:31.096415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:31.131088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176763d6-ab35-41f2-acbc-c450b8896ce2 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:31.166185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd5924-eff1-43a8-a554-adeb1d57beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:31.166751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5924-eff1-43a8-a554-adeb1d57beb8 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.167032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5924-eff1-43a8-a554-adeb1d57beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.167306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fd5924-eff1-43a8-a554-adeb1d57beb8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.178570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fd5924-eff1-43a8-a554-adeb1d57beb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-a1fd5924-eff1-43a8-a554-adeb1d57beb8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:31.183342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:31.184256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:31.185176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 460/936] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:31.190332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143b3c9-1502-40fb-bade-927659f31d74 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:31.239845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:31.244711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd5924-eff1-43a8-a554-adeb1d57beb8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:31.304904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8143b3c9-1502-40fb-bade-927659f31d74 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:31.344058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199a601-cdd9-4b3f-b917-0a29536151bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:31.344670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199a601-cdd9-4b3f-b917-0a29536151bd None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.344945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199a601-cdd9-4b3f-b917-0a29536151bd None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.345224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c199a601-cdd9-4b3f-b917-0a29536151bd None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.345906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199a601-cdd9-4b3f-b917-0a29536151bd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:31.346203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199a601-cdd9-4b3f-b917-0a29536151bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:31.347618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c199a601-cdd9-4b3f-b917-0a29536151bd None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:31.362711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 477/937] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:31.363690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199a601-cdd9-4b3f-b917-0a29536151bd None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:31.382965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fd5924-eff1-43a8-a554-adeb1d57beb8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:31.426769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:31.438633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:31.439500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.439983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.440858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.442075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:31.443833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:31.448917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING keystone.server.flask.common [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 17 00:36:31.472301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.sql.core [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 00:36:31.472301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 00:36:31.472301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [parameters: {'id': 'f9c2915bc7d942f4be3df3abc715d388', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 00:36:31.472301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87919) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 00:36:31.480460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c199a601-cdd9-4b3f-b917-0a29536151bd None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:31.489849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9c2915bc7d942f4be3df3abc715d388.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9c2915bc7d942f4be3df3abc715d388. Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:36:31.492221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application result.read() Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 17 00:36:31.493168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application yield resource Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise self.value Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application session.commit() Sep 17 00:36:31.494231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self.session.flush() Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application compat.raise_( Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 00:36:31.495144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 00:36:31.496031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application result.read() Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:36:31.498255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [parameters: {'id': 'f9c2915bc7d942f4be3df3abc715d388', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:31.499537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:31.500629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:31.502201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:31.502201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 17 00:36:31.502201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 17 00:36:31.502201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:31.502201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:31.502201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 17 00:36:31.502201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 17 00:36:31.502201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f9c2915bc7d942f4be3df3abc715d388. Sep 17 00:36:31.502201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:31.510491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 461/938] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Sep 17 00:36:31 2022] POST /identity/v3/projects => generated 262 bytes in 262 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:31.512035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:31.533819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0588837-9ce7-4163-88fd-8a307e8aaf0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:31.534930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588837-9ce7-4163-88fd-8a307e8aaf0c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.535749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588837-9ce7-4163-88fd-8a307e8aaf0c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.536174 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0588837-9ce7-4163-88fd-8a307e8aaf0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.549607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0588837-9ce7-4163-88fd-8a307e8aaf0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:31.551277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0588837-9ce7-4163-88fd-8a307e8aaf0c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-f0588837-9ce7-4163-88fd-8a307e8aaf0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:31.569863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:31.571041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:31.572156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:31.572156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:31.572156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:31.574250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 478/939] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:31.579946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0588837-9ce7-4163-88fd-8a307e8aaf0c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:31.635745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad93d76-4c6f-4c60-a07d-dbf73331b7e8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:31.673185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec1ad-70ad-44fb-8d58-be0b191a6ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:31.674065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec1ad-70ad-44fb-8d58-be0b191a6ef1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.674473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec1ad-70ad-44fb-8d58-be0b191a6ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.674887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ec1ad-70ad-44fb-8d58-be0b191a6ef1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.682407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec1ad-70ad-44fb-8d58-be0b191a6ef1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:31.684339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ec1ad-70ad-44fb-8d58-be0b191a6ef1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:31.696864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0588837-9ce7-4163-88fd-8a307e8aaf0c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-5d7ec1ad-70ad-44fb-8d58-be0b191a6ef1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:31.699375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:31.700276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:31.701470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:31.701470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:31.701470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:31.701470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:31.701470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:31.701470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:31.701470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:31.701470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:31.703505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 462/940] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:31.709722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec1ad-70ad-44fb-8d58-be0b191a6ef1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:31.739687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9924a0-d53c-40e0-8a8a-3c7e3ad47ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:31.740844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9924a0-d53c-40e0-8a8a-3c7e3ad47ff4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.741277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9924a0-d53c-40e0-8a8a-3c7e3ad47ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.741713 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9924a0-d53c-40e0-8a8a-3c7e3ad47ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.742642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9924a0-d53c-40e0-8a8a-3c7e3ad47ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:31.743074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9924a0-d53c-40e0-8a8a-3c7e3ad47ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:31.744658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9924a0-d53c-40e0-8a8a-3c7e3ad47ff4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:31.764666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 479/941] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:31.766146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9924a0-d53c-40e0-8a8a-3c7e3ad47ff4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:31.776104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:31.792003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:31.843042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ec1ad-70ad-44fb-8d58-be0b191a6ef1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:31.884004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9924a0-d53c-40e0-8a8a-3c7e3ad47ff4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:31.884570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6398410-14f8-432d-9841-19bd53e704e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:31.885375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6398410-14f8-432d-9841-19bd53e704e9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.886032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6398410-14f8-432d-9841-19bd53e704e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.886340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6398410-14f8-432d-9841-19bd53e704e9 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.887067 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6398410-14f8-432d-9841-19bd53e704e9 None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:31.887432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6398410-14f8-432d-9841-19bd53e704e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:31.889625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6398410-14f8-432d-9841-19bd53e704e9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:31.917450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 463/942] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:31.935621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a0538-b331-45b5-b05d-28169eb4daab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:31.936653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0538-b331-45b5-b05d-28169eb4daab None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:31.937075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0538-b331-45b5-b05d-28169eb4daab None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:31.937545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a0538-b331-45b5-b05d-28169eb4daab None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:31.946409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a0538-b331-45b5-b05d-28169eb4daab None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:31.948172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a0538-b331-45b5-b05d-28169eb4daab None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-674a0538-b331-45b5-b05d-28169eb4daab None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:31.962177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:31.963590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:31.964646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:31.967008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 480/943] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:31.973090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6398410-14f8-432d-9841-19bd53e704e9 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.022056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad46a92-c9bb-4eb2-acf1-a3e61f0ae1a4 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.022344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad46a92-c9bb-4eb2-acf1-a3e61f0ae1a4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.022625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad46a92-c9bb-4eb2-acf1-a3e61f0ae1a4 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.024327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 481/944] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:32.030361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f74c-af32-4661-b6bb-ed272819d2d4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.030633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f74c-af32-4661-b6bb-ed272819d2d4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.030901 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed4f74c-af32-4661-b6bb-ed272819d2d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.054979 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-fed4f74c-af32-4661-b6bb-ed272819d2d4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:32.056505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fed4f74c-af32-4661-b6bb-ed272819d2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:32.093244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6398410-14f8-432d-9841-19bd53e704e9 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.103327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.138571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb798703-df44-4b09-b2c2-72524d89cfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.139184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb798703-df44-4b09-b2c2-72524d89cfc8 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.139454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb798703-df44-4b09-b2c2-72524d89cfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.139940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb798703-df44-4b09-b2c2-72524d89cfc8 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.140047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 482/945] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:32.140452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb798703-df44-4b09-b2c2-72524d89cfc8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:32.140753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb798703-df44-4b09-b2c2-72524d89cfc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.142701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb798703-df44-4b09-b2c2-72524d89cfc8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.165842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 464/946] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:32.167111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f74c-af32-4661-b6bb-ed272819d2d4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.179325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.279834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed4f74c-af32-4661-b6bb-ed272819d2d4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.316222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0a7d-d1f2-4266-905b-d66665b01637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.316966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0a7d-d1f2-4266-905b-d66665b01637 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.317253 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0a7d-d1f2-4266-905b-d66665b01637 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.317569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c0a7d-d1f2-4266-905b-d66665b01637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.328430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0a7d-d1f2-4266-905b-d66665b01637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.330048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c0a7d-d1f2-4266-905b-d66665b01637 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-604c0a7d-d1f2-4266-905b-d66665b01637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:32.346033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:32.347007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:32.347918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:32.347918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:32.347918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:32.347918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 483/947] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:32.353205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb798703-df44-4b09-b2c2-72524d89cfc8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.430044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0a7d-d1f2-4266-905b-d66665b01637 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.470865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb798703-df44-4b09-b2c2-72524d89cfc8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.500944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.514801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5ae7a-d39e-4561-9aca-5c594de37281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.515628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5ae7a-d39e-4561-9aca-5c594de37281 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.517534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5ae7a-d39e-4561-9aca-5c594de37281 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.518057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f5ae7a-d39e-4561-9aca-5c594de37281 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.518856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5ae7a-d39e-4561-9aca-5c594de37281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:32.519316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5ae7a-d39e-4561-9aca-5c594de37281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.520842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f5ae7a-d39e-4561-9aca-5c594de37281 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.533118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 465/948] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:32.540957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5ae7a-d39e-4561-9aca-5c594de37281 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.550377 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c0a7d-d1f2-4266-905b-d66665b01637 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.570733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.592066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c280cb-9212-4a1d-b424-f72dc5da3c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.592935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c280cb-9212-4a1d-b424-f72dc5da3c84 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.593498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c280cb-9212-4a1d-b424-f72dc5da3c84 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.593914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c280cb-9212-4a1d-b424-f72dc5da3c84 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.594637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c280cb-9212-4a1d-b424-f72dc5da3c84 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.596271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c280cb-9212-4a1d-b424-f72dc5da3c84 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-58c280cb-9212-4a1d-b424-f72dc5da3c84 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:32.605870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:32.607485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:32.608297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:32.611136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 484/949] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:32.618216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c280cb-9212-4a1d-b424-f72dc5da3c84 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.662318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f5ae7a-d39e-4561-9aca-5c594de37281 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.699816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842eb08-9e6e-4f7c-87c7-63cbcae3ac82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.701037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842eb08-9e6e-4f7c-87c7-63cbcae3ac82 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.701553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842eb08-9e6e-4f7c-87c7-63cbcae3ac82 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.702034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e842eb08-9e6e-4f7c-87c7-63cbcae3ac82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.710514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842eb08-9e6e-4f7c-87c7-63cbcae3ac82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.712677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e842eb08-9e6e-4f7c-87c7-63cbcae3ac82 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-e842eb08-9e6e-4f7c-87c7-63cbcae3ac82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:32.726821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:32.727769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:32.728653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:32.728653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:32.728653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:32.728653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:32.728653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:32.728653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:32.728653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:32.728653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:32.729754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c280cb-9212-4a1d-b424-f72dc5da3c84 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.732450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 466/950] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:32.738006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842eb08-9e6e-4f7c-87c7-63cbcae3ac82 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.768321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.781382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a429-3fd2-4b0c-b23c-e8cb47ea3d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.782881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a429-3fd2-4b0c-b23c-e8cb47ea3d16 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.783432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a429-3fd2-4b0c-b23c-e8cb47ea3d16 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.783887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b71a429-3fd2-4b0c-b23c-e8cb47ea3d16 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.785175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a429-3fd2-4b0c-b23c-e8cb47ea3d16 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:32.785690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a429-3fd2-4b0c-b23c-e8cb47ea3d16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.787948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b71a429-3fd2-4b0c-b23c-e8cb47ea3d16 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.800637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 485/951] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:32.801164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a429-3fd2-4b0c-b23c-e8cb47ea3d16 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.837765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:32.854218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e842eb08-9e6e-4f7c-87c7-63cbcae3ac82 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.892609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef7f30-ab2b-4a94-8d4f-a499604ff56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.893219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef7f30-ab2b-4a94-8d4f-a499604ff56b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.893560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef7f30-ab2b-4a94-8d4f-a499604ff56b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.894117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef7f30-ab2b-4a94-8d4f-a499604ff56b None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.895085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef7f30-ab2b-4a94-8d4f-a499604ff56b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:32.895388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef7f30-ab2b-4a94-8d4f-a499604ff56b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.897326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef7f30-ab2b-4a94-8d4f-a499604ff56b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.913560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 467/952] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:32.914991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4af1d-827e-4ebb-a234-c9f317eb33c9 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.915282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4af1d-827e-4ebb-a234-c9f317eb33c9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.915560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4af1d-827e-4ebb-a234-c9f317eb33c9 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.916793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 468/953] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:32.918778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4af1d-827e-4ebb-a234-c9f317eb33c9 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:32.924586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b71a429-3fd2-4b0c-b23c-e8cb47ea3d16 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:32.963205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5831c8-baa6-420a-9015-4c0aa4778a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:32.964073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5831c8-baa6-420a-9015-4c0aa4778a97 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.964352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5831c8-baa6-420a-9015-4c0aa4778a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.964625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5831c8-baa6-420a-9015-4c0aa4778a97 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.965260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5831c8-baa6-420a-9015-4c0aa4778a97 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:32.965618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5831c8-baa6-420a-9015-4c0aa4778a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:32.967636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5831c8-baa6-420a-9015-4c0aa4778a97 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:32.972535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 486/954] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:32.973688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3a618-7e2e-4724-a68b-fefea881ed97 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:32.973969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3a618-7e2e-4724-a68b-fefea881ed97 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:32.974240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb3a618-7e2e-4724-a68b-fefea881ed97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:32.996667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7bb3a618-7e2e-4724-a68b-fefea881ed97 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:32.997924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7bb3a618-7e2e-4724-a68b-fefea881ed97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:33.034708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a4af1d-827e-4ebb-a234-c9f317eb33c9 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.049793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.071028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65df3c-fe42-4580-93bc-00f84828388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.071694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65df3c-fe42-4580-93bc-00f84828388d None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.071969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65df3c-fe42-4580-93bc-00f84828388d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.072243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65df3c-fe42-4580-93bc-00f84828388d None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/e639d502dd3c46199da050a0f71de561/roles/15a4044f85c94d1eb8032a1fd3c5ed13` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.073531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 487/955] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:33.074564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65df3c-fe42-4580-93bc-00f84828388d None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=e639d502dd3c46199da050a0f71de561, role_id=15a4044f85c94d1eb8032a1fd3c5ed13)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.074732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3a618-7e2e-4724-a68b-fefea881ed97 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.076169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a65df3c-fe42-4580-93bc-00f84828388d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.091617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 469/956] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:32 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/e639d502dd3c46199da050a0f71de561/roles/15a4044f85c94d1eb8032a1fd3c5ed13 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:33.192821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb3a618-7e2e-4724-a68b-fefea881ed97 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.232789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bd688-a98e-4161-add1-13321d48db8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.233737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bd688-a98e-4161-add1-13321d48db8f None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.234184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bd688-a98e-4161-add1-13321d48db8f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.234613 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bd688-a98e-4161-add1-13321d48db8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.235504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bd688-a98e-4161-add1-13321d48db8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.237040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bd688-a98e-4161-add1-13321d48db8f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.261309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 488/957] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:33 2022] POST /identity/v3/endpoints => generated 349 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:33.376422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65df3c-fe42-4580-93bc-00f84828388d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.386036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.488601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65df3c-fe42-4580-93bc-00f84828388d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.534318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f68b17-c9c5-41de-9ffd-166261f6ce53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.534952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68b17-c9c5-41de-9ffd-166261f6ce53 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.535231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68b17-c9c5-41de-9ffd-166261f6ce53 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.535507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f68b17-c9c5-41de-9ffd-166261f6ce53 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.536090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f68b17-c9c5-41de-9ffd-166261f6ce53 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.537480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f68b17-c9c5-41de-9ffd-166261f6ce53 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-32f68b17-c9c5-41de-9ffd-166261f6ce53 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:33.546934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:33.548030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:33.548934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:33.552947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 470/958] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:33.554328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bd688-a98e-4161-add1-13321d48db8f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.599419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.668133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bd688-a98e-4161-add1-13321d48db8f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.705175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4141b65-4112-425a-bd56-59974a3ecf36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.706067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4141b65-4112-425a-bd56-59974a3ecf36 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.706507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4141b65-4112-425a-bd56-59974a3ecf36 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.707077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4141b65-4112-425a-bd56-59974a3ecf36 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.707960 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4141b65-4112-425a-bd56-59974a3ecf36 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:33.708445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4141b65-4112-425a-bd56-59974a3ecf36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.710011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4141b65-4112-425a-bd56-59974a3ecf36 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.715919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 489/959] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:33.722680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f68b17-c9c5-41de-9ffd-166261f6ce53 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:33.799632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:33.844132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f68b17-c9c5-41de-9ffd-166261f6ce53 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:33.887071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98e9d44-95f4-4cd9-bfbb-084eb4beb9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:33.888221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e9d44-95f4-4cd9-bfbb-084eb4beb9c1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:33.888682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e9d44-95f4-4cd9-bfbb-084eb4beb9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:33.889128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98e9d44-95f4-4cd9-bfbb-084eb4beb9c1 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:33.889949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e9d44-95f4-4cd9-bfbb-084eb4beb9c1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:33.890402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e9d44-95f4-4cd9-bfbb-084eb4beb9c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:33.891999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98e9d44-95f4-4cd9-bfbb-084eb4beb9c1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:33.905436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 471/960] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:34.274486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cc748-a24d-4c95-9d22-e69c053ef20e None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:34.275374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cc748-a24d-4c95-9d22-e69c053ef20e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:34.275804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cc748-a24d-4c95-9d22-e69c053ef20e None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:34.277536 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 490/961] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:34.283213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0461e-1711-4e66-a6bb-2392dde9931d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:34.283760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0461e-1711-4e66-a6bb-2392dde9931d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:34.284239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f0461e-1711-4e66-a6bb-2392dde9931d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:34.306103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-15f0461e-1711-4e66-a6bb-2392dde9931d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:34.307931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-15f0461e-1711-4e66-a6bb-2392dde9931d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:34.387399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 472/962] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:34.691042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cc748-a24d-4c95-9d22-e69c053ef20e None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:34.808547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cc748-a24d-4c95-9d22-e69c053ef20e None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:34.813396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:34.849889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:34.850503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:34.850785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:34.851064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:34.851728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:34.853153 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:34.855782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WARNING keystone.server.flask.common [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 17 00:36:34.870200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.sql.core [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 00:36:34.870200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 00:36:34.870200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [parameters: {'user_id': 'caadfcb3e9a046b8a0b10847134c8594', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 00:36:34.870200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87920) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application result.read() Sep 17 00:36:34.877700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:36:34.878598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application yield resource Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application next(self.gen) Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.session.rollback() Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.force_reraise() Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise self.value Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application session.commit() Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 17 00:36:34.879984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._prepare_impl() Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.session.flush() Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._flush(objects) Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application compat.raise_( Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application flush_context.execute() Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rec.execute(self) Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 17 00:36:34.881093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 17 00:36:34.882885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application result = self._query(query) Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application conn.query(q) Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application result.read() Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 17 00:36:34.884956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [parameters: {'user_id': 'caadfcb3e9a046b8a0b10847134c8594', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:34.891084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 17 00:36:34.893053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 17 00:36:34.895374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 17 00:36:34.895374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 17 00:36:34.895374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 17 00:36:34.895374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 17 00:36:34.895374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 17 00:36:34.895374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:34.895374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 491/963] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 17 00:36:34 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:34.896304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0461e-1711-4e66-a6bb-2392dde9931d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:34.949675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:34.999789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f0461e-1711-4e66-a6bb-2392dde9931d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:35.037076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f47e141-d6b5-4c8c-9331-ccb6730b08fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:35.037759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e141-d6b5-4c8c-9331-ccb6730b08fd None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.038040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e141-d6b5-4c8c-9331-ccb6730b08fd None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.038313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f47e141-d6b5-4c8c-9331-ccb6730b08fd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.045976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47e141-d6b5-4c8c-9331-ccb6730b08fd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:35.047519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f47e141-d6b5-4c8c-9331-ccb6730b08fd None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-8f47e141-d6b5-4c8c-9331-ccb6730b08fd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:35.059592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:35.061874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:35.064130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 473/964] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:35.068635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:35.172133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef6b012-73f4-47bd-ab71-9b8c141d0ddd None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:35.209575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bc977e-29ea-47dc-a608-35e79ea1af75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:35.210137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc977e-29ea-47dc-a608-35e79ea1af75 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.210420 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc977e-29ea-47dc-a608-35e79ea1af75 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.210701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bc977e-29ea-47dc-a608-35e79ea1af75 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.211442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc977e-29ea-47dc-a608-35e79ea1af75 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:35.211749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc977e-29ea-47dc-a608-35e79ea1af75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:35.213750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bc977e-29ea-47dc-a608-35e79ea1af75 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:35.255900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 492/965] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 17 00:36:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:35.331386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076396f-5332-451d-86b0-561bb8a50222 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.331666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076396f-5332-451d-86b0-561bb8a50222 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.331942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076396f-5332-451d-86b0-561bb8a50222 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.333524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 474/966] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:35.339733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f633a7-e143-49a7-a09b-8fa8627a14db None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.340622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f633a7-e143-49a7-a09b-8fa8627a14db None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.341642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f633a7-e143-49a7-a09b-8fa8627a14db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.361929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e9f633a7-e143-49a7-a09b-8fa8627a14db None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:35.363867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e9f633a7-e143-49a7-a09b-8fa8627a14db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:35.383594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:35.448359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 493/967] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:35.566853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26907197-5424-46c4-8d12-238c3d11fc4a None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.567246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26907197-5424-46c4-8d12-238c3d11fc4a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.567398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26907197-5424-46c4-8d12-238c3d11fc4a None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.568854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 475/968] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:35.574418 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055af27-02de-4a38-9948-4b09716a1ddb None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.574721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055af27-02de-4a38-9948-4b09716a1ddb None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.575005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8055af27-02de-4a38-9948-4b09716a1ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.594961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8055af27-02de-4a38-9948-4b09716a1ddb None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:35.596116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8055af27-02de-4a38-9948-4b09716a1ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:35.672817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 494/969] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:35.718904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26907197-5424-46c4-8d12-238c3d11fc4a None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:35.822259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26907197-5424-46c4-8d12-238c3d11fc4a None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:35.842719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:35.858016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d460f-d4f4-4750-ae29-ca9866135d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:35.858729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d460f-d4f4-4750-ae29-ca9866135d38 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:35.859012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d460f-d4f4-4750-ae29-ca9866135d38 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:35.859325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652d460f-d4f4-4750-ae29-ca9866135d38 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:35.872287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652d460f-d4f4-4750-ae29-ca9866135d38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-652d460f-d4f4-4750-ae29-ca9866135d38 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:35.877076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:35.878355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:35.879214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 476/970] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:35.885897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055af27-02de-4a38-9948-4b09716a1ddb None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:35.940153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d460f-d4f4-4750-ae29-ca9866135d38 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:35.971258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:35.989697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8055af27-02de-4a38-9948-4b09716a1ddb None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.025214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b2634-e9a9-45c5-8ad2-a78d9c809e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.025931 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b2634-e9a9-45c5-8ad2-a78d9c809e9a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.026210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b2634-e9a9-45c5-8ad2-a78d9c809e9a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.026480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978b2634-e9a9-45c5-8ad2-a78d9c809e9a None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.027228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b2634-e9a9-45c5-8ad2-a78d9c809e9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:36.027531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b2634-e9a9-45c5-8ad2-a78d9c809e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.029515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978b2634-e9a9-45c5-8ad2-a78d9c809e9a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.044802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 495/971] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:36.046078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b2634-e9a9-45c5-8ad2-a78d9c809e9a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.063021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652d460f-d4f4-4750-ae29-ca9866135d38 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.100684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4de7b-d3e8-4645-9b29-b8e3efaf88b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.101623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4de7b-d3e8-4645-9b29-b8e3efaf88b6 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.102044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4de7b-d3e8-4645-9b29-b8e3efaf88b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.102617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4de7b-d3e8-4645-9b29-b8e3efaf88b6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.103205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4de7b-d3e8-4645-9b29-b8e3efaf88b6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.104611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4de7b-d3e8-4645-9b29-b8e3efaf88b6 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-cef4de7b-d3e8-4645-9b29-b8e3efaf88b6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:36.114256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:36.115265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:36.116097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 477/972] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:36.121180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4de7b-d3e8-4645-9b29-b8e3efaf88b6 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.154206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978b2634-e9a9-45c5-8ad2-a78d9c809e9a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.168490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.187230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a70722-9034-4749-be3d-d32feb6e9c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.187876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70722-9034-4749-be3d-d32feb6e9c71 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.188157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70722-9034-4749-be3d-d32feb6e9c71 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.188426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a70722-9034-4749-be3d-d32feb6e9c71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.198470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a70722-9034-4749-be3d-d32feb6e9c71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.199935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a70722-9034-4749-be3d-d32feb6e9c71 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.206198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-e4a70722-9034-4749-be3d-d32feb6e9c71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:36.214869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:36.216472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:36.217383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:36.217383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:36.217383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:36.217383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 496/973] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:36.217840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33807416-c10c-4d31-a3e5-845096481576 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.218126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33807416-c10c-4d31-a3e5-845096481576 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.218402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33807416-c10c-4d31-a3e5-845096481576 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.219741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 497/974] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:36.222058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33807416-c10c-4d31-a3e5-845096481576 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.227714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4de7b-d3e8-4645-9b29-b8e3efaf88b6 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.260850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432ebf4f-406c-4a32-8064-51eef684cefa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.261480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ebf4f-406c-4a32-8064-51eef684cefa None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.261763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ebf4f-406c-4a32-8064-51eef684cefa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.262038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432ebf4f-406c-4a32-8064-51eef684cefa None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.262663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ebf4f-406c-4a32-8064-51eef684cefa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:36.263497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ebf4f-406c-4a32-8064-51eef684cefa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.264843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432ebf4f-406c-4a32-8064-51eef684cefa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.269384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 478/975] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:36.270662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83ffae-63fc-445b-a0f4-5ef7c1817e04 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.270952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83ffae-63fc-445b-a0f4-5ef7c1817e04 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.271228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a83ffae-63fc-445b-a0f4-5ef7c1817e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.288344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0a83ffae-63fc-445b-a0f4-5ef7c1817e04 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:36.289579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0a83ffae-63fc-445b-a0f4-5ef7c1817e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:36.323919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33807416-c10c-4d31-a3e5-845096481576 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.355984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 479/976] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:36.356732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83ffae-63fc-445b-a0f4-5ef7c1817e04 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.356995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71786e-0a15-4906-a8d7-b374906146d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.357787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71786e-0a15-4906-a8d7-b374906146d7 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.358069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71786e-0a15-4906-a8d7-b374906146d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.358342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71786e-0a15-4906-a8d7-b374906146d7 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.358982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71786e-0a15-4906-a8d7-b374906146d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:36.359285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71786e-0a15-4906-a8d7-b374906146d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.360639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e71786e-0a15-4906-a8d7-b374906146d7 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.376560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 498/977] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:36.381983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71786e-0a15-4906-a8d7-b374906146d7 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.398162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.453953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.464756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a83ffae-63fc-445b-a0f4-5ef7c1817e04 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.498855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71786e-0a15-4906-a8d7-b374906146d7 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.499730 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4549ee-2ab1-440b-aa23-cf543d9900ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.500342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4549ee-2ab1-440b-aa23-cf543d9900ae None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.500619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4549ee-2ab1-440b-aa23-cf543d9900ae None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.500887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4549ee-2ab1-440b-aa23-cf543d9900ae None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.501582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4549ee-2ab1-440b-aa23-cf543d9900ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:36.501887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4549ee-2ab1-440b-aa23-cf543d9900ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.503247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4549ee-2ab1-440b-aa23-cf543d9900ae None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.508330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 480/978] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:36.514807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4549ee-2ab1-440b-aa23-cf543d9900ae None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.540861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ca51-71a7-4ab1-8095-cafdec8299ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.542042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ca51-71a7-4ab1-8095-cafdec8299ce None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.542532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ca51-71a7-4ab1-8095-cafdec8299ce None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.542998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629ca51-71a7-4ab1-8095-cafdec8299ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.552082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629ca51-71a7-4ab1-8095-cafdec8299ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.553726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f629ca51-71a7-4ab1-8095-cafdec8299ce None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-f629ca51-71a7-4ab1-8095-cafdec8299ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:36.568765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:36.570026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 17 00:36:36.571007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:36.573543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 499/979] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:36.576160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ca51-71a7-4ab1-8095-cafdec8299ce None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.625639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4549ee-2ab1-440b-aa23-cf543d9900ae None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.627137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.660549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa30c-2447-430a-a6fd-f7d0d657ec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.661154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa30c-2447-430a-a6fd-f7d0d657ec39 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.661460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa30c-2447-430a-a6fd-f7d0d657ec39 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.661737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afaa30c-2447-430a-a6fd-f7d0d657ec39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.662451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa30c-2447-430a-a6fd-f7d0d657ec39 None admin] RBAC: Adding query filter params (interface=admin, service_id=d73a3f36fcb5494396a0934507e64d28, region_id=RegionOne) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:36.662754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa30c-2447-430a-a6fd-f7d0d657ec39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.664122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afaa30c-2447-430a-a6fd-f7d0d657ec39 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.669240 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 481/980] 10.222.0.16 () {56 vars in 1249 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/endpoints?service_id=d73a3f36fcb5494396a0934507e64d28&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:36.669816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa30c-2447-430a-a6fd-f7d0d657ec39 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.681278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629ca51-71a7-4ab1-8095-cafdec8299ce None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.698097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.715471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ae5f-4e2a-4259-aa90-d729f6211396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.716647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ae5f-4e2a-4259-aa90-d729f6211396 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.716929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ae5f-4e2a-4259-aa90-d729f6211396 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.717201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858ae5f-4e2a-4259-aa90-d729f6211396 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.717959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ae5f-4e2a-4259-aa90-d729f6211396 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:36.718264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ae5f-4e2a-4259-aa90-d729f6211396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.719681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858ae5f-4e2a-4259-aa90-d729f6211396 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.736358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 500/981] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:36.737155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ae5f-4e2a-4259-aa90-d729f6211396 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.771255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afaa30c-2447-430a-a6fd-f7d0d657ec39 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.803983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babf062-a2b9-499e-9955-d70a6c49c0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.804591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babf062-a2b9-499e-9955-d70a6c49c0f6 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.804870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babf062-a2b9-499e-9955-d70a6c49c0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.805138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0babf062-a2b9-499e-9955-d70a6c49c0f6 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.805810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babf062-a2b9-499e-9955-d70a6c49c0f6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.807161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0babf062-a2b9-499e-9955-d70a6c49c0f6 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.821361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 482/982] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:36 2022] POST /identity/v3/services => generated 242 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:36.822173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babf062-a2b9-499e-9955-d70a6c49c0f6 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:36.834906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858ae5f-4e2a-4259-aa90-d729f6211396 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.853151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:36.884395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ade49-cfef-4c1d-9d44-d7dd61e3a15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.884926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ade49-cfef-4c1d-9d44-d7dd61e3a15d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.885203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ade49-cfef-4c1d-9d44-d7dd61e3a15d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.885507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ade49-cfef-4c1d-9d44-d7dd61e3a15d None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:36.886128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ade49-cfef-4c1d-9d44-d7dd61e3a15d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:36.887511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ade49-cfef-4c1d-9d44-d7dd61e3a15d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:36.894440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 501/983] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:36:36.957051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0babf062-a2b9-499e-9955-d70a6c49c0f6 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:36.998235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b3caf-8677-49b8-9517-4b88b226d8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:36.998866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b3caf-8677-49b8-9517-4b88b226d8ea None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:36.999155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b3caf-8677-49b8-9517-4b88b226d8ea None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:36.999405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b3caf-8677-49b8-9517-4b88b226d8ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.078342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b3caf-8677-49b8-9517-4b88b226d8ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.079810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3b3caf-8677-49b8-9517-4b88b226d8ea None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.108741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.181122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 483/984] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:36 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:37.186436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ade49-cfef-4c1d-9d44-d7dd61e3a15d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.222854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.295939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ade49-cfef-4c1d-9d44-d7dd61e3a15d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.331631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e494-573d-4c1b-b49f-6151c6b0b574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.332255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e494-573d-4c1b-b49f-6151c6b0b574 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.332528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e494-573d-4c1b-b49f-6151c6b0b574 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.332795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f858e494-573d-4c1b-b49f-6151c6b0b574 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.343577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e494-573d-4c1b-b49f-6151c6b0b574 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.344998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f858e494-573d-4c1b-b49f-6151c6b0b574 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-f858e494-573d-4c1b-b49f-6151c6b0b574 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:37.359358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:37.360750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:37.361714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:37.361714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:37.361714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:37.365335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 502/985] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:37.366323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b3caf-8677-49b8-9517-4b88b226d8ea None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.472360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b3caf-8677-49b8-9517-4b88b226d8ea None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.499259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.508979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848ce34-3bc3-41d5-b68a-967564740da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.509615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848ce34-3bc3-41d5-b68a-967564740da4 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.509898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848ce34-3bc3-41d5-b68a-967564740da4 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.510172 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3848ce34-3bc3-41d5-b68a-967564740da4 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.510817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848ce34-3bc3-41d5-b68a-967564740da4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:37.511121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848ce34-3bc3-41d5-b68a-967564740da4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.512483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3848ce34-3bc3-41d5-b68a-967564740da4 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.529014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 484/986] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:37.530056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e494-573d-4c1b-b49f-6151c6b0b574 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.628078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:37.641806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f858e494-573d-4c1b-b49f-6151c6b0b574 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.680091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4a80a-1049-47f5-9bc9-c9e1bf78550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.680724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4a80a-1049-47f5-9bc9-c9e1bf78550e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.681005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4a80a-1049-47f5-9bc9-c9e1bf78550e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.681278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c4a80a-1049-47f5-9bc9-c9e1bf78550e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.688147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4a80a-1049-47f5-9bc9-c9e1bf78550e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.689599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c4a80a-1049-47f5-9bc9-c9e1bf78550e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-30c4a80a-1049-47f5-9bc9-c9e1bf78550e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:37.700704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:37.701644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:37.702561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:37.702561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:37.702561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:37.702561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:37.702561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:37.702561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:37.702561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:37.702561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:37.702561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 503/987] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:37.708960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848ce34-3bc3-41d5-b68a-967564740da4 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.811058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3848ce34-3bc3-41d5-b68a-967564740da4 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:37.851955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb068ad-7055-4313-b52c-ccac23cf23fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:37.852555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb068ad-7055-4313-b52c-ccac23cf23fb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:37.852830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb068ad-7055-4313-b52c-ccac23cf23fb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:37.853099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb068ad-7055-4313-b52c-ccac23cf23fb None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:37.853811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb068ad-7055-4313-b52c-ccac23cf23fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:37.854114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb068ad-7055-4313-b52c-ccac23cf23fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:37.855529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb068ad-7055-4313-b52c-ccac23cf23fb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:37.867328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 485/988] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:37.873070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4a80a-1049-47f5-9bc9-c9e1bf78550e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:37.989307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c4a80a-1049-47f5-9bc9-c9e1bf78550e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:38.023299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9dd8fc-d9ef-41f0-bb03-9de4e91c6a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:38.023896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd8fc-d9ef-41f0-bb03-9de4e91c6a0a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:38.024171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd8fc-d9ef-41f0-bb03-9de4e91c6a0a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:38.024438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9dd8fc-d9ef-41f0-bb03-9de4e91c6a0a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:38.025157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dd8fc-d9ef-41f0-bb03-9de4e91c6a0a None admin] RBAC: Adding query filter params (role.id=15a4044f85c94d1eb8032a1fd3c5ed13, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=e639d502dd3c46199da050a0f71de561) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:38.025481 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dd8fc-d9ef-41f0-bb03-9de4e91c6a0a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:38.026888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9dd8fc-d9ef-41f0-bb03-9de4e91c6a0a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:38.032916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 504/989] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:37 2022] GET /identity/v3/role_assignments?user.id=e639d502dd3c46199da050a0f71de561&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=15a4044f85c94d1eb8032a1fd3c5ed13 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:39.041144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdbb9d-e8d3-415f-a90f-9aea66a5e811 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.041759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdbb9d-e8d3-415f-a90f-9aea66a5e811 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.041759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bdbb9d-e8d3-415f-a90f-9aea66a5e811 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.043106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 486/990] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:39.048210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df383e09-15e2-402a-990d-f55dcf87a174 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.048619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df383e09-15e2-402a-990d-f55dcf87a174 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.048810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df383e09-15e2-402a-990d-f55dcf87a174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.067430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-df383e09-15e2-402a-990d-f55dcf87a174 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:39.068607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-df383e09-15e2-402a-990d-f55dcf87a174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:39.077086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:39.094832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144281b-4f64-40a1-a2f3-5124e480df97 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.095106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144281b-4f64-40a1-a2f3-5124e480df97 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.095384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144281b-4f64-40a1-a2f3-5124e480df97 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.096709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 487/991] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:39.101710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc6f3-fe59-4dff-bbff-01682afc3826 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.102054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc6f3-fe59-4dff-bbff-01682afc3826 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.102393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fc6f3-fe59-4dff-bbff-01682afc3826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.121922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7c2fc6f3-fe59-4dff-bbff-01682afc3826 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:39.123617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7c2fc6f3-fe59-4dff-bbff-01682afc3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:39.143622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 505/992] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:39.171820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:39.197421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 488/993] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:39.410095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df383e09-15e2-402a-990d-f55dcf87a174 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.474682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fc6f3-fe59-4dff-bbff-01682afc3826 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.516845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df383e09-15e2-402a-990d-f55dcf87a174 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.554325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8a9a-51af-40e3-adc0-c98d65603e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.554958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8a9a-51af-40e3-adc0-c98d65603e4d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.555359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8a9a-51af-40e3-adc0-c98d65603e4d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.555635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8a9a-51af-40e3-adc0-c98d65603e4d None admin] PATH_INFO: `/v3/services/compute` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.556224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8a9a-51af-40e3-adc0-c98d65603e4d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.557607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8a9a-51af-40e3-adc0-c98d65603e4d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-6b8e8a9a-51af-40e3-adc0-c98d65603e4d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:39.566949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:39.567921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:39.568864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 506/994] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:39 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:39.573944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8a9a-51af-40e3-adc0-c98d65603e4d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.580209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fc6f3-fe59-4dff-bbff-01682afc3826 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.583724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:39.617822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f70e-ecdf-44f6-a137-e7c3cadf5171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.618460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f70e-ecdf-44f6-a137-e7c3cadf5171 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.618739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f70e-ecdf-44f6-a137-e7c3cadf5171 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.619029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520f70e-ecdf-44f6-a137-e7c3cadf5171 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.619639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520f70e-ecdf-44f6-a137-e7c3cadf5171 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.621484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9520f70e-ecdf-44f6-a137-e7c3cadf5171 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-9520f70e-ecdf-44f6-a137-e7c3cadf5171 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:39.631118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:39.632117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:39.634454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 489/995] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 17 00:36:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:39.638414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f70e-ecdf-44f6-a137-e7c3cadf5171 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.689313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:39.695997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8a9a-51af-40e3-adc0-c98d65603e4d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.734825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d52afb-4834-4763-bf9f-bf323e5af1ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.735433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d52afb-4834-4763-bf9f-bf323e5af1ca None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.735713 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d52afb-4834-4763-bf9f-bf323e5af1ca None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.735986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d52afb-4834-4763-bf9f-bf323e5af1ca None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.736624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d52afb-4834-4763-bf9f-bf323e5af1ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:39.736927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d52afb-4834-4763-bf9f-bf323e5af1ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.738341 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d52afb-4834-4763-bf9f-bf323e5af1ca None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.748476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 507/996] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:39 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:39.749395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d52afb-4834-4763-bf9f-bf323e5af1ca None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.754339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9520f70e-ecdf-44f6-a137-e7c3cadf5171 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.791862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73439649-46ec-47a4-904d-1088fbec0bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.792464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73439649-46ec-47a4-904d-1088fbec0bfc None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.792740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73439649-46ec-47a4-904d-1088fbec0bfc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.793009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73439649-46ec-47a4-904d-1088fbec0bfc None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.793655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73439649-46ec-47a4-904d-1088fbec0bfc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:39.793985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73439649-46ec-47a4-904d-1088fbec0bfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.795347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73439649-46ec-47a4-904d-1088fbec0bfc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.800475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 490/997] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:39.806037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73439649-46ec-47a4-904d-1088fbec0bfc None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.833467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:39.871097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d52afb-4834-4763-bf9f-bf323e5af1ca None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.907845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8562e-4050-4401-b7d0-7ce6543f3093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.908453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8562e-4050-4401-b7d0-7ce6543f3093 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.908734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8562e-4050-4401-b7d0-7ce6543f3093 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.909008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e8562e-4050-4401-b7d0-7ce6543f3093 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.909603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73439649-46ec-47a4-904d-1088fbec0bfc None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:39.909709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8562e-4050-4401-b7d0-7ce6543f3093 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:39.909959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8562e-4050-4401-b7d0-7ce6543f3093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.911314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e8562e-4050-4401-b7d0-7ce6543f3093 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.912855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:39.922279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 508/998] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:39 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:39.924765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8562e-4050-4401-b7d0-7ce6543f3093 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:39.948014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0211510-dd2c-43fc-9011-598b7402bb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:39.948629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211510-dd2c-43fc-9011-598b7402bb92 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:39.948909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211510-dd2c-43fc-9011-598b7402bb92 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:39.949177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0211510-dd2c-43fc-9011-598b7402bb92 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:39.949844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0211510-dd2c-43fc-9011-598b7402bb92 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:39.950169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0211510-dd2c-43fc-9011-598b7402bb92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:39.951531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0211510-dd2c-43fc-9011-598b7402bb92 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:39.961663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 491/999] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 17 00:36:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:39.962512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0211510-dd2c-43fc-9011-598b7402bb92 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:40.028266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e8562e-4050-4401-b7d0-7ce6543f3093 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:40.063010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19826e-d2e0-43e2-ac88-f403638874e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:40.063636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19826e-d2e0-43e2-ac88-f403638874e0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.063893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19826e-d2e0-43e2-ac88-f403638874e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.064168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19826e-d2e0-43e2-ac88-f403638874e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.064876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19826e-d2e0-43e2-ac88-f403638874e0 None admin] RBAC: Adding query filter params (interface=public, service_id=76c4e21cfb894303b4db6a8691a881f7, region_id=RegionOne) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:40.065181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19826e-d2e0-43e2-ac88-f403638874e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:40.066578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19826e-d2e0-43e2-ac88-f403638874e0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:40.068014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:40.070320 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0211510-dd2c-43fc-9011-598b7402bb92 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:40.073442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 509/1000] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:39 2022] GET /identity/v3/endpoints?service_id=76c4e21cfb894303b4db6a8691a881f7&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:40.078556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19826e-d2e0-43e2-ac88-f403638874e0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:40.114484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70810f-e9a7-4c9e-8135-1ba14e35f91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:40.115070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70810f-e9a7-4c9e-8135-1ba14e35f91d None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.115356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70810f-e9a7-4c9e-8135-1ba14e35f91d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.115633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70810f-e9a7-4c9e-8135-1ba14e35f91d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.116324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70810f-e9a7-4c9e-8135-1ba14e35f91d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:40.117748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70810f-e9a7-4c9e-8135-1ba14e35f91d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:40.145437 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 492/1001] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:36:40.193168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19826e-d2e0-43e2-ac88-f403638874e0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:40.213720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8edba-3876-438e-b40a-a5091345619f None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.214028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8edba-3876-438e-b40a-a5091345619f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.214239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b8edba-3876-438e-b40a-a5091345619f None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.215804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 493/1002] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:40.221626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c2a68-341b-4a48-a522-31bace8bffb7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.222404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c2a68-341b-4a48-a522-31bace8bffb7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.222404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c2a68-341b-4a48-a522-31bace8bffb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.239441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781ccc-ce17-4d96-94dc-6651e619c0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:40.240059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781ccc-ce17-4d96-94dc-6651e619c0e6 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.240333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781ccc-ce17-4d96-94dc-6651e619c0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.240605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61781ccc-ce17-4d96-94dc-6651e619c0e6 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.241207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61781ccc-ce17-4d96-94dc-6651e619c0e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:40.242368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-760c2a68-341b-4a48-a522-31bace8bffb7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:40.242644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61781ccc-ce17-4d96-94dc-6651e619c0e6 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:40.243644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-760c2a68-341b-4a48-a522-31bace8bffb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:40.257208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 510/1003] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:40 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:36:40.270626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:40.326419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 494/1004] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:40.593282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781ccc-ce17-4d96-94dc-6651e619c0e6 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:40.652832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:40.694527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61781ccc-ce17-4d96-94dc-6651e619c0e6 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:40.727615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dadd4c-e8fd-4016-9483-5b0f2f3a7912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:40.728247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadd4c-e8fd-4016-9483-5b0f2f3a7912 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.728525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadd4c-e8fd-4016-9483-5b0f2f3a7912 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.728797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadd4c-e8fd-4016-9483-5b0f2f3a7912 None admin] PATH_INFO: `/v3/services/image` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.729386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadd4c-e8fd-4016-9483-5b0f2f3a7912 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:40.730773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadd4c-e8fd-4016-9483-5b0f2f3a7912 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-71dadd4c-e8fd-4016-9483-5b0f2f3a7912 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:40.740092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:40.741125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:40.742311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:40.745746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 511/1005] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Sep 17 00:36:40 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:40.747018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c2a68-341b-4a48-a522-31bace8bffb7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:40.850425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c2a68-341b-4a48-a522-31bace8bffb7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:40.883792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab393d-3d12-4814-b927-0ab9043f4b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:40.884407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab393d-3d12-4814-b927-0ab9043f4b02 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:40.884748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab393d-3d12-4814-b927-0ab9043f4b02 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:40.885029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab393d-3d12-4814-b927-0ab9043f4b02 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:40.885691 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab393d-3d12-4814-b927-0ab9043f4b02 None admin] RBAC: Adding query filter params (name=image) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:40.885997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab393d-3d12-4814-b927-0ab9043f4b02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:40.887373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ab393d-3d12-4814-b927-0ab9043f4b02 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:40.897281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 495/1006] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:40.898297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dadd4c-e8fd-4016-9483-5b0f2f3a7912 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:41.001368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dadd4c-e8fd-4016-9483-5b0f2f3a7912 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:41.024027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:41.037772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6919-f6ef-4204-b9f8-8a8879912d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:41.038469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6919-f6ef-4204-b9f8-8a8879912d9b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:41.038756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6919-f6ef-4204-b9f8-8a8879912d9b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:41.039032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6919-f6ef-4204-b9f8-8a8879912d9b None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:41.039695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6919-f6ef-4204-b9f8-8a8879912d9b None admin] RBAC: Adding query filter params (type=image) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:41.040001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6919-f6ef-4204-b9f8-8a8879912d9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:41.041440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6919-f6ef-4204-b9f8-8a8879912d9b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:41.053452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 512/1007] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:42.301119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6c8c4-d0eb-40fc-aac3-461eb3ed9d04 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.301701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6c8c4-d0eb-40fc-aac3-461eb3ed9d04 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.301701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6c8c4-d0eb-40fc-aac3-461eb3ed9d04 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.303169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 496/1008] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:42.308828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24151e44-fe54-4efd-a045-47846071b399 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.309338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24151e44-fe54-4efd-a045-47846071b399 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.310123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24151e44-fe54-4efd-a045-47846071b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.329248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-24151e44-fe54-4efd-a045-47846071b399 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:42.330506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-24151e44-fe54-4efd-a045-47846071b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:42.400690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 513/1009] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:42.433394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4a303-cc55-4a31-b60a-025715aa5ee9 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.433737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4a303-cc55-4a31-b60a-025715aa5ee9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.433982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4a303-cc55-4a31-b60a-025715aa5ee9 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.436025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 497/1010] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:42.440997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a2b82-98bf-425c-8744-0adda3ef6409 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.441289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a2b82-98bf-425c-8744-0adda3ef6409 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.441595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21a2b82-98bf-425c-8744-0adda3ef6409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.459600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a21a2b82-98bf-425c-8744-0adda3ef6409 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:42.460773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a21a2b82-98bf-425c-8744-0adda3ef6409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:42.527228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 514/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:42.669246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4a303-cc55-4a31-b60a-025715aa5ee9 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.694280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:42.774224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4a303-cc55-4a31-b60a-025715aa5ee9 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.794393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a2b82-98bf-425c-8744-0adda3ef6409 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.808250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a82090-c878-4d1c-a21d-b0203abd4f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.809128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a82090-c878-4d1c-a21d-b0203abd4f07 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.809922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a82090-c878-4d1c-a21d-b0203abd4f07 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.810230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a82090-c878-4d1c-a21d-b0203abd4f07 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.811341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a82090-c878-4d1c-a21d-b0203abd4f07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.812761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a82090-c878-4d1c-a21d-b0203abd4f07 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.817645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 498/1012] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:42.820522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a82090-c878-4d1c-a21d-b0203abd4f07 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.844192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:42.904269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21a2b82-98bf-425c-8744-0adda3ef6409 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.914754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:42.925688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a82090-c878-4d1c-a21d-b0203abd4f07 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:42.942713 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782c4aa-e4f7-49ec-a11c-12912ce13854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.943343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782c4aa-e4f7-49ec-a11c-12912ce13854 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.943619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782c4aa-e4f7-49ec-a11c-12912ce13854 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.943886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782c4aa-e4f7-49ec-a11c-12912ce13854 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.944472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782c4aa-e4f7-49ec-a11c-12912ce13854 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.945858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782c4aa-e4f7-49ec-a11c-12912ce13854 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-1782c4aa-e4f7-49ec-a11c-12912ce13854 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:42.955695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:42.956702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:42.957616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 515/1013] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:42.963144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782c4aa-e4f7-49ec-a11c-12912ce13854 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:42.964591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a6a7a-14fe-4c5f-b36c-c97638cc6445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:42.965208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a6a7a-14fe-4c5f-b36c-c97638cc6445 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:42.965524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a6a7a-14fe-4c5f-b36c-c97638cc6445 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:42.965864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46a6a7a-14fe-4c5f-b36c-c97638cc6445 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:42.966530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a6a7a-14fe-4c5f-b36c-c97638cc6445 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:42.967959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46a6a7a-14fe-4c5f-b36c-c97638cc6445 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:42.998525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 499/1014] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:42 2022] POST /identity/v3/projects => generated 311 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:36:43.089754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782c4aa-e4f7-49ec-a11c-12912ce13854 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:43.102762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:43.131508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6a65b-d028-4934-8c85-8d7ee01f0a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:43.132135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a65b-d028-4934-8c85-8d7ee01f0a49 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:43.132410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a65b-d028-4934-8c85-8d7ee01f0a49 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:43.132679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6a65b-d028-4934-8c85-8d7ee01f0a49 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:43.133329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a65b-d028-4934-8c85-8d7ee01f0a49 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:43.133675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a65b-d028-4934-8c85-8d7ee01f0a49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:43.135073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6a65b-d028-4934-8c85-8d7ee01f0a49 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:43.145672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 516/1015] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:43.147584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a6a7a-14fe-4c5f-b36c-c97638cc6445 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:43.220919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b119fe-2da6-4da2-9145-8b95db795e01 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:43.221601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b119fe-2da6-4da2-9145-8b95db795e01 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:43.221880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b119fe-2da6-4da2-9145-8b95db795e01 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:43.223252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 517/1016] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:43.228632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe540c5-627e-4aaa-a51c-5dfeae0a2085 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:43.229040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe540c5-627e-4aaa-a51c-5dfeae0a2085 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:43.229322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe540c5-627e-4aaa-a51c-5dfeae0a2085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:43.250813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-afe540c5-627e-4aaa-a51c-5dfeae0a2085 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:43.252128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-afe540c5-627e-4aaa-a51c-5dfeae0a2085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:43.254549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46a6a7a-14fe-4c5f-b36c-c97638cc6445 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:43.289096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc74630-c588-4494-aeed-bdb85708d426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:43.289758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74630-c588-4494-aeed-bdb85708d426 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:43.290035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74630-c588-4494-aeed-bdb85708d426 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:43.290304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc74630-c588-4494-aeed-bdb85708d426 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:43.290940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74630-c588-4494-aeed-bdb85708d426 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:43.291245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74630-c588-4494-aeed-bdb85708d426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:43.292750 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc74630-c588-4494-aeed-bdb85708d426 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:43.305555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 500/1017] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 17 00:36:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:43.309028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc74630-c588-4494-aeed-bdb85708d426 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:43.320385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:43.330127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 518/1018] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:43 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:43.414257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc74630-c588-4494-aeed-bdb85708d426 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:43.451026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367c99b2-c992-4a53-8caf-dee4c8363dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:43.451635 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c99b2-c992-4a53-8caf-dee4c8363dd8 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:43.451916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c99b2-c992-4a53-8caf-dee4c8363dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:43.452190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367c99b2-c992-4a53-8caf-dee4c8363dd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:43.452859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c99b2-c992-4a53-8caf-dee4c8363dd8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:43.454251 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367c99b2-c992-4a53-8caf-dee4c8363dd8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:43.475265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 501/1019] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:43 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:36:43.603306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe540c5-627e-4aaa-a51c-5dfeae0a2085 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:43.710834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe540c5-627e-4aaa-a51c-5dfeae0a2085 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:43.713270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:43.754816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e27650-34c5-4690-aba4-360687a006cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:43.755445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e27650-34c5-4690-aba4-360687a006cb None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:43.755732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e27650-34c5-4690-aba4-360687a006cb None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:43.756005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e27650-34c5-4690-aba4-360687a006cb None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:43.756779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e27650-34c5-4690-aba4-360687a006cb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:43.758237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e27650-34c5-4690-aba4-360687a006cb None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:43.774190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 519/1020] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:36:43 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:45.214645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a46da7-411a-4613-8c0f-f9d9196eb0df None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.216235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a46da7-411a-4613-8c0f-f9d9196eb0df None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.216860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a46da7-411a-4613-8c0f-f9d9196eb0df None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.218752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 502/1021] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:45.223595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efc0cb-0273-46e4-a961-8d39f798834a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.224002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efc0cb-0273-46e4-a961-8d39f798834a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.224174 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6efc0cb-0273-46e4-a961-8d39f798834a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.242477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f6efc0cb-0273-46e4-a961-8d39f798834a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:45.243651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f6efc0cb-0273-46e4-a961-8d39f798834a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:45.317745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 520/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:45.588952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a46da7-411a-4613-8c0f-f9d9196eb0df None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:45.667043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:45.708284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a46da7-411a-4613-8c0f-f9d9196eb0df None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:45.725352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b907-2a54-4e11-bd1b-a65c3047d298 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.725675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b907-2a54-4e11-bd1b-a65c3047d298 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.725951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355b907-2a54-4e11-bd1b-a65c3047d298 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.727414 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 521/1023] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:45.732811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a2fca-62ae-46dd-9a80-aa6ab49c4f25 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.733090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a2fca-62ae-46dd-9a80-aa6ab49c4f25 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.733363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a2fca-62ae-46dd-9a80-aa6ab49c4f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.750271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb82f-ad69-44b7-9821-09a3804c318f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:45.750731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8e3a2fca-62ae-46dd-9a80-aa6ab49c4f25 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:45.751297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb82f-ad69-44b7-9821-09a3804c318f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.751740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb82f-ad69-44b7-9821-09a3804c318f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.751890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8e3a2fca-62ae-46dd-9a80-aa6ab49c4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:45.752306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056eb82f-ad69-44b7-9821-09a3804c318f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.753596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eb82f-ad69-44b7-9821-09a3804c318f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:45.755179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056eb82f-ad69-44b7-9821-09a3804c318f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:45.757066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 503/1024] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:45.762255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb82f-ad69-44b7-9821-09a3804c318f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:45.824718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 522/1025] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:45.873883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056eb82f-ad69-44b7-9821-09a3804c318f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:45.903810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:45.911167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b6cc5e-b1bb-4f27-a0f1-c51ce81d88a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:45.911751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6cc5e-b1bb-4f27-a0f1-c51ce81d88a2 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.912027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6cc5e-b1bb-4f27-a0f1-c51ce81d88a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.912302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b6cc5e-b1bb-4f27-a0f1-c51ce81d88a2 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.912957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6cc5e-b1bb-4f27-a0f1-c51ce81d88a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:45.914496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b6cc5e-b1bb-4f27-a0f1-c51ce81d88a2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:45.939881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 504/1026] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:36:45 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:36:45.975503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f5f8-3684-4182-a89e-65c0a815b43b None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.975822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f5f8-3684-4182-a89e-65c0a815b43b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.976070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c3f5f8-3684-4182-a89e-65c0a815b43b None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:45.977651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 523/1027] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:45.984402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79307270-9871-464f-bdfd-d9ef75aa77d7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:45.984729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79307270-9871-464f-bdfd-d9ef75aa77d7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:45.984948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79307270-9871-464f-bdfd-d9ef75aa77d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.017071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-79307270-9871-464f-bdfd-d9ef75aa77d7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:46.022951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-79307270-9871-464f-bdfd-d9ef75aa77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:46.100553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 505/1028] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:46.109907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3f5f8-3684-4182-a89e-65c0a815b43b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.131166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:46.225112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c3f5f8-3684-4182-a89e-65c0a815b43b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.258155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2319c0-9fba-4a79-970a-c6e6de40c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.258786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2319c0-9fba-4a79-970a-c6e6de40c91b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.259064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2319c0-9fba-4a79-970a-c6e6de40c91b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.259335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2319c0-9fba-4a79-970a-c6e6de40c91b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.269915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2319c0-9fba-4a79-970a-c6e6de40c91b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-ae2319c0-9fba-4a79-970a-c6e6de40c91b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:46.274720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:46.275757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:46.276673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 524/1029] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:46.282410 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79307270-9871-464f-bdfd-d9ef75aa77d7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.371230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2319c0-9fba-4a79-970a-c6e6de40c91b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.381538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79307270-9871-464f-bdfd-d9ef75aa77d7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.400055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:46.425385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a08d6-39b6-4082-85a5-b7887dc0aa76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.426035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a08d6-39b6-4082-85a5-b7887dc0aa76 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.426321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a08d6-39b6-4082-85a5-b7887dc0aa76 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.426596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a08d6-39b6-4082-85a5-b7887dc0aa76 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.427277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a08d6-39b6-4082-85a5-b7887dc0aa76 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:46.427601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a08d6-39b6-4082-85a5-b7887dc0aa76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.429091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352a08d6-39b6-4082-85a5-b7887dc0aa76 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.438497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 506/1030] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:46.444074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a08d6-39b6-4082-85a5-b7887dc0aa76 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.463035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:46.489921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2319c0-9fba-4a79-970a-c6e6de40c91b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.525681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117c733-6b8b-4839-ab92-4cb9622fbaf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.526317 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117c733-6b8b-4839-ab92-4cb9622fbaf4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.526597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117c733-6b8b-4839-ab92-4cb9622fbaf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.527220 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a117c733-6b8b-4839-ab92-4cb9622fbaf4 None admin] PATH_INFO: `/v3/services/image` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.527808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117c733-6b8b-4839-ab92-4cb9622fbaf4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.529731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a117c733-6b8b-4839-ab92-4cb9622fbaf4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-a117c733-6b8b-4839-ab92-4cb9622fbaf4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:46.538881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:46.540001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:46.541700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 525/1031] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:46.546076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117c733-6b8b-4839-ab92-4cb9622fbaf4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.552341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a08d6-39b6-4082-85a5-b7887dc0aa76 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.587883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aecd8-4562-4088-a9f1-3ee17aeb8265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.588777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aecd8-4562-4088-a9f1-3ee17aeb8265 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.589062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aecd8-4562-4088-a9f1-3ee17aeb8265 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.589340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747aecd8-4562-4088-a9f1-3ee17aeb8265 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.602019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747aecd8-4562-4088-a9f1-3ee17aeb8265 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.603655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747aecd8-4562-4088-a9f1-3ee17aeb8265 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-747aecd8-4562-4088-a9f1-3ee17aeb8265 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:46.618128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:46.619111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:46.620032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:46.620032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:46.620032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:46.620032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 507/1032] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:46.625632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aecd8-4562-4088-a9f1-3ee17aeb8265 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.658413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:46.658702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a117c733-6b8b-4839-ab92-4cb9622fbaf4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.694211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e74cf-5609-4f72-980b-5a6bf4db5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.694931 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e74cf-5609-4f72-980b-5a6bf4db5af8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.695214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e74cf-5609-4f72-980b-5a6bf4db5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.695557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20e74cf-5609-4f72-980b-5a6bf4db5af8 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.696198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e74cf-5609-4f72-980b-5a6bf4db5af8 None admin] RBAC: Adding query filter params (name=image) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:46.696531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e74cf-5609-4f72-980b-5a6bf4db5af8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.697945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20e74cf-5609-4f72-980b-5a6bf4db5af8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.702962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 526/1033] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:46.708701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e74cf-5609-4f72-980b-5a6bf4db5af8 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.712861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:46.734208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747aecd8-4562-4088-a9f1-3ee17aeb8265 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.770614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd634-57d5-4023-b439-91236013d66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.771342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd634-57d5-4023-b439-91236013d66c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.771623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd634-57d5-4023-b439-91236013d66c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.772014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bfd634-57d5-4023-b439-91236013d66c None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.772657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd634-57d5-4023-b439-91236013d66c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:46.772956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd634-57d5-4023-b439-91236013d66c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.774482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bfd634-57d5-4023-b439-91236013d66c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.791716 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 508/1034] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:46.792749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd634-57d5-4023-b439-91236013d66c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.820825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20e74cf-5609-4f72-980b-5a6bf4db5af8 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.859445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa658d-b639-4e12-9dd0-ef0fb6c49182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.860163 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa658d-b639-4e12-9dd0-ef0fb6c49182 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.860437 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa658d-b639-4e12-9dd0-ef0fb6c49182 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.861121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa658d-b639-4e12-9dd0-ef0fb6c49182 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.861465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa658d-b639-4e12-9dd0-ef0fb6c49182 None admin] RBAC: Adding query filter params (type=image) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:46.861767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa658d-b639-4e12-9dd0-ef0fb6c49182 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.863120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa658d-b639-4e12-9dd0-ef0fb6c49182 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.873521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 527/1035] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:46.875141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa658d-b639-4e12-9dd0-ef0fb6c49182 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.890785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:46.901162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bfd634-57d5-4023-b439-91236013d66c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:46.935911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f389-8ce8-42a9-9752-c56dac9ca85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:46.936463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f389-8ce8-42a9-9752-c56dac9ca85e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:46.936764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f389-8ce8-42a9-9752-c56dac9ca85e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:46.937009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e87f389-8ce8-42a9-9752-c56dac9ca85e None admin] PATH_INFO: `/v3/users/nova` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:46.944750 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87f389-8ce8-42a9-9752-c56dac9ca85e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:46.946222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e87f389-8ce8-42a9-9752-c56dac9ca85e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:46.948969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-4e87f389-8ce8-42a9-9752-c56dac9ca85e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:46.957800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:46.958798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:46.959809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 509/1036] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:46.964807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f389-8ce8-42a9-9752-c56dac9ca85e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:46.992295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa658d-b639-4e12-9dd0-ef0fb6c49182 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:47.027346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939cff9-e195-478f-8d48-9f0936ff35b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:47.027956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939cff9-e195-478f-8d48-9f0936ff35b7 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.028360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939cff9-e195-478f-8d48-9f0936ff35b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.028806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4939cff9-e195-478f-8d48-9f0936ff35b7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.029311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939cff9-e195-478f-8d48-9f0936ff35b7 None admin] RBAC: Adding query filter params (interface=public, service_id=c0b9c51c430d4994b344c57564bff9c1, region_id=RegionOne) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:47.029650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939cff9-e195-478f-8d48-9f0936ff35b7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:47.031043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4939cff9-e195-478f-8d48-9f0936ff35b7 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:47.041200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 528/1037] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/endpoints?service_id=c0b9c51c430d4994b344c57564bff9c1&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:47.042259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939cff9-e195-478f-8d48-9f0936ff35b7 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:47.074970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e87f389-8ce8-42a9-9752-c56dac9ca85e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:47.110045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9af9d-8883-437c-a4ac-76a0f684e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:47.110648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9af9d-8883-437c-a4ac-76a0f684e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.110929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9af9d-8883-437c-a4ac-76a0f684e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.111198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9af9d-8883-437c-a4ac-76a0f684e7a2 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.111916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9af9d-8883-437c-a4ac-76a0f684e7a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:47.112222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9af9d-8883-437c-a4ac-76a0f684e7a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:47.113672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9af9d-8883-437c-a4ac-76a0f684e7a2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:47.131382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 510/1038] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:47.137102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9af9d-8883-437c-a4ac-76a0f684e7a2 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:47.147651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:47.152752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4939cff9-e195-478f-8d48-9f0936ff35b7 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:47.186665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:47.193416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c9fd8-df07-4a08-ae43-5524447b7a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:47.194142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c9fd8-df07-4a08-ae43-5524447b7a06 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.194421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c9fd8-df07-4a08-ae43-5524447b7a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.194968 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c9fd8-df07-4a08-ae43-5524447b7a06 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.195412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c9fd8-df07-4a08-ae43-5524447b7a06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:47.197005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c9fd8-df07-4a08-ae43-5524447b7a06 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:47.216398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 529/1039] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 17 00:36:47 2022] GET /identity/v3/services => generated 1957 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:36:47.251897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9af9d-8883-437c-a4ac-76a0f684e7a2 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:47.289214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39c318-364b-4428-822e-ead4004eaf64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:47.289917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39c318-364b-4428-822e-ead4004eaf64 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.290135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39c318-364b-4428-822e-ead4004eaf64 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.290408 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39c318-364b-4428-822e-ead4004eaf64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.363093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39c318-364b-4428-822e-ead4004eaf64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:47.364569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39c318-364b-4428-822e-ead4004eaf64 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:47.375562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:47.472587 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 511/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:47 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 00:36:47.478164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c9fd8-df07-4a08-ae43-5524447b7a06 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:47.577653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c9fd8-df07-4a08-ae43-5524447b7a06 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:47.611080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5845b61-2384-4b58-b2ba-5263d35d5bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:47.611706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5845b61-2384-4b58-b2ba-5263d35d5bad None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.611980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5845b61-2384-4b58-b2ba-5263d35d5bad None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.612248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5845b61-2384-4b58-b2ba-5263d35d5bad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.622641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5845b61-2384-4b58-b2ba-5263d35d5bad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:47.624065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5845b61-2384-4b58-b2ba-5263d35d5bad None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-c5845b61-2384-4b58-b2ba-5263d35d5bad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:47.638385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:47.639351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:47.640276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:47.640276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:47.640276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:47.641542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 530/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:47.645388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39c318-364b-4428-822e-ead4004eaf64 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:47.745809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39c318-364b-4428-822e-ead4004eaf64 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:47.755081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:47.780734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da761863-3831-45ac-accb-03c79edd80b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:47.781335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761863-3831-45ac-accb-03c79edd80b8 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.781633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761863-3831-45ac-accb-03c79edd80b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.781902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da761863-3831-45ac-accb-03c79edd80b8 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.782538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da761863-3831-45ac-accb-03c79edd80b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:47.782835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da761863-3831-45ac-accb-03c79edd80b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:47.784186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da761863-3831-45ac-accb-03c79edd80b8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:47.795967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 512/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:47.801533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5845b61-2384-4b58-b2ba-5263d35d5bad None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:47.852862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:47.906959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5845b61-2384-4b58-b2ba-5263d35d5bad None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:47.943508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e23ccf-253e-4833-b349-c4a7d25fa38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:47.944144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e23ccf-253e-4833-b349-c4a7d25fa38c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:47.944427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e23ccf-253e-4833-b349-c4a7d25fa38c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:47.944703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e23ccf-253e-4833-b349-c4a7d25fa38c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:47.951984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e23ccf-253e-4833-b349-c4a7d25fa38c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:47.953459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e23ccf-253e-4833-b349-c4a7d25fa38c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-e6e23ccf-253e-4833-b349-c4a7d25fa38c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:47.964942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:47.966083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:47.971741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:47.971741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:47.971741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:47.971741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:47.971741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:47.971741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:47.971741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:47.971741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:47.971741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 531/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:47.973857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da761863-3831-45ac-accb-03c79edd80b8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:48.081045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da761863-3831-45ac-accb-03c79edd80b8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:48.116522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40d630-e4ae-4972-8056-b95c631590ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:48.117145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40d630-e4ae-4972-8056-b95c631590ea None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.117444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40d630-e4ae-4972-8056-b95c631590ea None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.117724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40d630-e4ae-4972-8056-b95c631590ea None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.118431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40d630-e4ae-4972-8056-b95c631590ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:48.118739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40d630-e4ae-4972-8056-b95c631590ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:48.120187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b40d630-e4ae-4972-8056-b95c631590ea None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:48.133447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 513/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:48.140044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e23ccf-253e-4833-b349-c4a7d25fa38c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:48.172681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e536-9eef-425c-9c85-dc8609b4d34b None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.172984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e536-9eef-425c-9c85-dc8609b4d34b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.173241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2841e536-9eef-425c-9c85-dc8609b4d34b None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.174860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 514/1045] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:48.179528 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f568e6d-786d-44cf-990f-f7b104ed120c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.179914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f568e6d-786d-44cf-990f-f7b104ed120c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.180199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f568e6d-786d-44cf-990f-f7b104ed120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.199062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3f568e6d-786d-44cf-990f-f7b104ed120c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:48.200417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3f568e6d-786d-44cf-990f-f7b104ed120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:48.224705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:48.242070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e23ccf-253e-4833-b349-c4a7d25fa38c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:48.251345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:48.271271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 515/1046] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:48.278388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb7390-4dc6-468d-a75e-d315e3e6c613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:48.279213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb7390-4dc6-468d-a75e-d315e3e6c613 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.279683 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb7390-4dc6-468d-a75e-d315e3e6c613 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.280152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebb7390-4dc6-468d-a75e-d315e3e6c613 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.281054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb7390-4dc6-468d-a75e-d315e3e6c613 None admin] RBAC: Adding query filter params (role.id=15a4044f85c94d1eb8032a1fd3c5ed13, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=2dbd23de9096446091fb9b7f79f047fc) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:48.281647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb7390-4dc6-468d-a75e-d315e3e6c613 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:48.283353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebb7390-4dc6-468d-a75e-d315e3e6c613 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:48.297472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 532/1047] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:48 2022] GET /identity/v3/role_assignments?user.id=2dbd23de9096446091fb9b7f79f047fc&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=15a4044f85c94d1eb8032a1fd3c5ed13 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:48.540699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f568e6d-786d-44cf-990f-f7b104ed120c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:48.640592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f568e6d-786d-44cf-990f-f7b104ed120c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:48.674198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dd957-2808-467b-9ff2-e2df0b7aa727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:48.674762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd957-2808-467b-9ff2-e2df0b7aa727 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.675038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd957-2808-467b-9ff2-e2df0b7aa727 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.675309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511dd957-2808-467b-9ff2-e2df0b7aa727 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.685933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511dd957-2808-467b-9ff2-e2df0b7aa727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-511dd957-2808-467b-9ff2-e2df0b7aa727 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:48.690676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:48.691581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:48.692409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 516/1048] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:48.699084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb7390-4dc6-468d-a75e-d315e3e6c613 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:48.808430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebb7390-4dc6-468d-a75e-d315e3e6c613 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:48.843752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d826821-f32a-4e62-8ee0-287702c61f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:48.844365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d826821-f32a-4e62-8ee0-287702c61f45 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:48.844642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d826821-f32a-4e62-8ee0-287702c61f45 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:48.844912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d826821-f32a-4e62-8ee0-287702c61f45 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:48.845601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d826821-f32a-4e62-8ee0-287702c61f45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:48.845906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d826821-f32a-4e62-8ee0-287702c61f45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:48.847264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d826821-f32a-4e62-8ee0-287702c61f45 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:48.856233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 533/1049] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:48.861951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dd957-2808-467b-9ff2-e2df0b7aa727 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:48.883283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:48.976881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511dd957-2808-467b-9ff2-e2df0b7aa727 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.019264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041dca1-1a95-4aec-bad6-d7c063c19d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.020305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041dca1-1a95-4aec-bad6-d7c063c19d8d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.020789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041dca1-1a95-4aec-bad6-d7c063c19d8d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.021270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c041dca1-1a95-4aec-bad6-d7c063c19d8d None admin] PATH_INFO: `/v3/users/d35e00507a794bae9aced18245c4b194` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.036614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041dca1-1a95-4aec-bad6-d7c063c19d8d None admin] RBAC: Authorizing `identity:get_user(user_id=d35e00507a794bae9aced18245c4b194)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.038482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c041dca1-1a95-4aec-bad6-d7c063c19d8d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.040936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 517/1050] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:36:48 2022] GET /identity/v3/users/d35e00507a794bae9aced18245c4b194 => generated 285 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:49.046804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d826821-f32a-4e62-8ee0-287702c61f45 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.091601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:49.178111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d826821-f32a-4e62-8ee0-287702c61f45 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.218844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f00ebc7-a4a1-49c1-9517-03b40c2ac292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.219456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ebc7-a4a1-49c1-9517-03b40c2ac292 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.219733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ebc7-a4a1-49c1-9517-03b40c2ac292 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.220004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f00ebc7-a4a1-49c1-9517-03b40c2ac292 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.287585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ebc7-a4a1-49c1-9517-03b40c2ac292 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.289088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f00ebc7-a4a1-49c1-9517-03b40c2ac292 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.323763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:49.396152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 534/1051] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:49.397427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041dca1-1a95-4aec-bad6-d7c063c19d8d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.404737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ff667-eb58-447b-8339-e0e3ed19652a None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.405028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ff667-eb58-447b-8339-e0e3ed19652a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.405307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ff667-eb58-447b-8339-e0e3ed19652a None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.406665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 535/1052] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:49.411639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48402e14-a7d9-4a54-8622-81f8aa0c0ea2 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.411935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48402e14-a7d9-4a54-8622-81f8aa0c0ea2 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.412215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48402e14-a7d9-4a54-8622-81f8aa0c0ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.438624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-48402e14-a7d9-4a54-8622-81f8aa0c0ea2 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:49.439803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-48402e14-a7d9-4a54-8622-81f8aa0c0ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:49.482089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:49.508511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c041dca1-1a95-4aec-bad6-d7c063c19d8d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.510908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 536/1053] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:49.549905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaff04-30dd-4454-95be-7dba8ed9c3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.550543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaff04-30dd-4454-95be-7dba8ed9c3a5 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.550736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaff04-30dd-4454-95be-7dba8ed9c3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.551008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddaff04-30dd-4454-95be-7dba8ed9c3a5 None admin] PATH_INFO: `/v3/projects/40efd1b7ca264382b1c6cad10dccc8da` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.552126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaff04-30dd-4454-95be-7dba8ed9c3a5 None admin] RBAC: Authorizing `identity:get_project(project_id=40efd1b7ca264382b1c6cad10dccc8da)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.553590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddaff04-30dd-4454-95be-7dba8ed9c3a5 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.560492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 518/1054] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/projects/40efd1b7ca264382b1c6cad10dccc8da => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:49.561720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48402e14-a7d9-4a54-8622-81f8aa0c0ea2 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.623862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:49.662145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48402e14-a7d9-4a54-8622-81f8aa0c0ea2 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.696612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259126b-acd5-4b38-b1de-614a9e4fcc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.697210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259126b-acd5-4b38-b1de-614a9e4fcc80 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.697515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259126b-acd5-4b38-b1de-614a9e4fcc80 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.697785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2259126b-acd5-4b38-b1de-614a9e4fcc80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.698502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259126b-acd5-4b38-b1de-614a9e4fcc80 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=40efd1b7ca264382b1c6cad10dccc8da, user.id=d35e00507a794bae9aced18245c4b194) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:49.698806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259126b-acd5-4b38-b1de-614a9e4fcc80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.700235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2259126b-acd5-4b38-b1de-614a9e4fcc80 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.709665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 537/1055] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/role_assignments?user.id=d35e00507a794bae9aced18245c4b194&scope.project.id=40efd1b7ca264382b1c6cad10dccc8da&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:49.780694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaff04-30dd-4454-95be-7dba8ed9c3a5 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:49.890696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddaff04-30dd-4454-95be-7dba8ed9c3a5 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:49.925413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652bffc-3c99-49a6-afac-0584768616f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:49.926063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652bffc-3c99-49a6-afac-0584768616f9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:49.926349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652bffc-3c99-49a6-afac-0584768616f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:49.926627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5652bffc-3c99-49a6-afac-0584768616f9 None admin] PATH_INFO: `/v3/services/image` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:49.927217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652bffc-3c99-49a6-afac-0584768616f9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:49.928585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5652bffc-3c99-49a6-afac-0584768616f9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-5652bffc-3c99-49a6-afac-0584768616f9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:49.939600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:49.940632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 17 00:36:49.941956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:49.945479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 519/1056] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:49.947455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259126b-acd5-4b38-b1de-614a9e4fcc80 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.051362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2259126b-acd5-4b38-b1de-614a9e4fcc80 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.077965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.087289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47fedc-c3ef-46b5-88f3-0e4d49b80c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.087841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47fedc-c3ef-46b5-88f3-0e4d49b80c12 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.088124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47fedc-c3ef-46b5-88f3-0e4d49b80c12 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.088644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47fedc-c3ef-46b5-88f3-0e4d49b80c12 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.089282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47fedc-c3ef-46b5-88f3-0e4d49b80c12 None admin] RBAC: Adding query filter params (name=image) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:50.089619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47fedc-c3ef-46b5-88f3-0e4d49b80c12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.091007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47fedc-c3ef-46b5-88f3-0e4d49b80c12 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.096282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 538/1057] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:50.101722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652bffc-3c99-49a6-afac-0584768616f9 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.113932 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.207993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5652bffc-3c99-49a6-afac-0584768616f9 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.240999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde60ca-8ce2-4ba2-9116-b9ff0973e7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.241647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde60ca-8ce2-4ba2-9116-b9ff0973e7f1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.241932 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde60ca-8ce2-4ba2-9116-b9ff0973e7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.242208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde60ca-8ce2-4ba2-9116-b9ff0973e7f1 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.242840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde60ca-8ce2-4ba2-9116-b9ff0973e7f1 None admin] RBAC: Adding query filter params (type=image) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:50.243143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde60ca-8ce2-4ba2-9116-b9ff0973e7f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.244514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde60ca-8ce2-4ba2-9116-b9ff0973e7f1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.254593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 520/1058] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:50.255788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47fedc-c3ef-46b5-88f3-0e4d49b80c12 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.360795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47fedc-c3ef-46b5-88f3-0e4d49b80c12 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.394891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7866b-eab5-4fca-b288-b83bb57a673e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.395509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7866b-eab5-4fca-b288-b83bb57a673e None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.395791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7866b-eab5-4fca-b288-b83bb57a673e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.396068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf7866b-eab5-4fca-b288-b83bb57a673e None admin] PATH_INFO: `/v3/endpoints` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.396747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7866b-eab5-4fca-b288-b83bb57a673e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:50.398167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf7866b-eab5-4fca-b288-b83bb57a673e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:50.419522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34242f4e-9214-4a99-8f73-4e81f598f99b None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.419907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34242f4e-9214-4a99-8f73-4e81f598f99b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.420161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34242f4e-9214-4a99-8f73-4e81f598f99b None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.421902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 521/1059] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:50.425567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 539/1060] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:36:50 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:36:50.426985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921beb8-9cff-48b1-bbdd-7188c25b38d0 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.427281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921beb8-9cff-48b1-bbdd-7188c25b38d0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.427569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921beb8-9cff-48b1-bbdd-7188c25b38d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.447309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3921beb8-9cff-48b1-bbdd-7188c25b38d0 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:50.448548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3921beb8-9cff-48b1-bbdd-7188c25b38d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:50.530881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.539961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 522/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:50.806869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7866b-eab5-4fca-b288-b83bb57a673e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:50.867559 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:50.921724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf7866b-eab5-4fca-b288-b83bb57a673e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:50.957019 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd85b9-0e65-4894-a825-cd0476693503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:50.958054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd85b9-0e65-4894-a825-cd0476693503 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:50.958570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd85b9-0e65-4894-a825-cd0476693503 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:50.959058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd85b9-0e65-4894-a825-cd0476693503 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:50.970632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd85b9-0e65-4894-a825-cd0476693503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-79dd85b9-0e65-4894-a825-cd0476693503 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:50.975679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:50.976610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:50.977466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:50.981681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 540/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:50.985157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921beb8-9cff-48b1-bbdd-7188c25b38d0 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.091362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921beb8-9cff-48b1-bbdd-7188c25b38d0 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.134630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2d014-945b-4ab3-870b-21330db0bf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.135252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2d014-945b-4ab3-870b-21330db0bf1c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.135532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2d014-945b-4ab3-870b-21330db0bf1c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.135806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2d014-945b-4ab3-870b-21330db0bf1c None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.136475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2d014-945b-4ab3-870b-21330db0bf1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:51.136779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2d014-945b-4ab3-870b-21330db0bf1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.138233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2d014-945b-4ab3-870b-21330db0bf1c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.146892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 523/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:51.152793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd85b9-0e65-4894-a825-cd0476693503 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.255764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd85b9-0e65-4894-a825-cd0476693503 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.265072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:51.290783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea961f1-68e1-4aef-99b8-ae547fb7ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.291407 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea961f1-68e1-4aef-99b8-ae547fb7ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.291680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea961f1-68e1-4aef-99b8-ae547fb7ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.291952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea961f1-68e1-4aef-99b8-ae547fb7ddf4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.302707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea961f1-68e1-4aef-99b8-ae547fb7ddf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.304137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea961f1-68e1-4aef-99b8-ae547fb7ddf4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-cea961f1-68e1-4aef-99b8-ae547fb7ddf4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:51.318352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:51.319325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:51.320303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:51.320303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:51.320303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:51.321753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 541/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:51.325186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2d014-945b-4ab3-870b-21330db0bf1c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.388999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:51.440472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2d014-945b-4ab3-870b-21330db0bf1c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.474031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995b1c9-2062-4cf1-b7bb-3c60b9e81be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.474647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995b1c9-2062-4cf1-b7bb-3c60b9e81be2 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.474929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995b1c9-2062-4cf1-b7bb-3c60b9e81be2 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.475201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8995b1c9-2062-4cf1-b7bb-3c60b9e81be2 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.475847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995b1c9-2062-4cf1-b7bb-3c60b9e81be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:51.476152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995b1c9-2062-4cf1-b7bb-3c60b9e81be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.477649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8995b1c9-2062-4cf1-b7bb-3c60b9e81be2 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.494625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 524/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:51.496053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea961f1-68e1-4aef-99b8-ae547fb7ddf4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.595802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea961f1-68e1-4aef-99b8-ae547fb7ddf4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.629010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2c9a6-94b5-4ace-be76-7a4fe1582c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.629666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c9a6-94b5-4ace-be76-7a4fe1582c9f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.629951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c9a6-94b5-4ace-be76-7a4fe1582c9f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.630227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2c9a6-94b5-4ace-be76-7a4fe1582c9f None admin] PATH_INFO: `/v3/users/nova` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.638582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2c9a6-94b5-4ace-be76-7a4fe1582c9f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.640073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2c9a6-94b5-4ace-be76-7a4fe1582c9f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-f0e2c9a6-94b5-4ace-be76-7a4fe1582c9f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:51.651023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:51.651964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:51.658229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 542/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:51.660529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995b1c9-2062-4cf1-b7bb-3c60b9e81be2 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.764702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8995b1c9-2062-4cf1-b7bb-3c60b9e81be2 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.785181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:51.800722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2984a2-1b7e-471e-a47c-594d37ca46be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.801325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2984a2-1b7e-471e-a47c-594d37ca46be None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.801631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2984a2-1b7e-471e-a47c-594d37ca46be None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.801904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2984a2-1b7e-471e-a47c-594d37ca46be None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.802630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2984a2-1b7e-471e-a47c-594d37ca46be None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:51.802934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2984a2-1b7e-471e-a47c-594d37ca46be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.804354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2984a2-1b7e-471e-a47c-594d37ca46be None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.825721 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 525/1067] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:51.827146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2c9a6-94b5-4ace-be76-7a4fe1582c9f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:51.849006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b40d9-a2c9-4868-a307-e678215cfc18 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.849302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b40d9-a2c9-4868-a307-e678215cfc18 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.849765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:51.850275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86b40d9-a2c9-4868-a307-e678215cfc18 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.851900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 526/1068] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:36:51.857841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfe686-9d13-4f76-acea-b360ed5e044f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.858258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfe686-9d13-4f76-acea-b360ed5e044f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.858630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfe686-9d13-4f76-acea-b360ed5e044f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.876669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-37dfe686-9d13-4f76-acea-b360ed5e044f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:51.877867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-37dfe686-9d13-4f76-acea-b360ed5e044f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:51.933688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2c9a6-94b5-4ace-be76-7a4fe1582c9f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:51.949506 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 527/1069] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:51.969032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191e160-38c6-464c-bcf1-a5497a201280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:51.969686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191e160-38c6-464c-bcf1-a5497a201280 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:51.969965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191e160-38c6-464c-bcf1-a5497a201280 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:51.970233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a191e160-38c6-464c-bcf1-a5497a201280 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:51.980520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191e160-38c6-464c-bcf1-a5497a201280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:51.982017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a191e160-38c6-464c-bcf1-a5497a201280 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-a191e160-38c6-464c-bcf1-a5497a201280 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:51.996570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:51.998105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:51.999015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:51.999015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:51.999015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:51.999878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 543/1070] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:52.003939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfe686-9d13-4f76-acea-b360ed5e044f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:52.100797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfe686-9d13-4f76-acea-b360ed5e044f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:52.110398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:52.136516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce14058-1106-42e5-b187-7054dd9ec0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:52.137119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce14058-1106-42e5-b187-7054dd9ec0d3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.137441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce14058-1106-42e5-b187-7054dd9ec0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.137715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce14058-1106-42e5-b187-7054dd9ec0d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.138350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce14058-1106-42e5-b187-7054dd9ec0d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:52.138649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce14058-1106-42e5-b187-7054dd9ec0d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:52.140005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce14058-1106-42e5-b187-7054dd9ec0d3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:52.151130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 528/1071] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:52.156487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191e160-38c6-464c-bcf1-a5497a201280 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:52.211331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce14058-1106-42e5-b187-7054dd9ec0d3 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:52.230744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:52.264860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a191e160-38c6-464c-bcf1-a5497a201280 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:52.302266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeda956-e5da-4385-82d6-199c374c74f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:52.302899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeda956-e5da-4385-82d6-199c374c74f5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.303175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeda956-e5da-4385-82d6-199c374c74f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.303446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeda956-e5da-4385-82d6-199c374c74f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.310194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeda956-e5da-4385-82d6-199c374c74f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:52.311617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeda956-e5da-4385-82d6-199c374c74f5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:52.319223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce14058-1106-42e5-b187-7054dd9ec0d3 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-adeda956-e5da-4385-82d6-199c374c74f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:52.322867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:52.323760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:52.330223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:52.330223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:52.330223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:52.330223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:52.330223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:52.330223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:52.330223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:52.330223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:52.330223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 544/1072] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:52.331081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeda956-e5da-4385-82d6-199c374c74f5 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:52.361018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aca5d-f873-4938-92bb-9b2150496baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:52.361685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aca5d-f873-4938-92bb-9b2150496baf None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.361970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aca5d-f873-4938-92bb-9b2150496baf None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.362243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834aca5d-f873-4938-92bb-9b2150496baf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.372816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834aca5d-f873-4938-92bb-9b2150496baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-834aca5d-f873-4938-92bb-9b2150496baf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:52.378046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:52.378989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:52.379820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 529/1073] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:52.385507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aca5d-f873-4938-92bb-9b2150496baf None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:52.422534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:52.451532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeda956-e5da-4385-82d6-199c374c74f5 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:52.481199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:52.487325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74208-b2f9-4500-8fde-bf9fc120f09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:52.488131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74208-b2f9-4500-8fde-bf9fc120f09b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.488602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74208-b2f9-4500-8fde-bf9fc120f09b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.489016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b74208-b2f9-4500-8fde-bf9fc120f09b None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.489878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74208-b2f9-4500-8fde-bf9fc120f09b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:52.490323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74208-b2f9-4500-8fde-bf9fc120f09b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:52.491898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b74208-b2f9-4500-8fde-bf9fc120f09b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:52.504265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834aca5d-f873-4938-92bb-9b2150496baf None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:52.509907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 545/1074] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:52.511084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74208-b2f9-4500-8fde-bf9fc120f09b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:52.541255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53a6d4-a3a2-4a06-b1f6-4f5a57d9129b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:52.541923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53a6d4-a3a2-4a06-b1f6-4f5a57d9129b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.542198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53a6d4-a3a2-4a06-b1f6-4f5a57d9129b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.542472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc53a6d4-a3a2-4a06-b1f6-4f5a57d9129b None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.543147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53a6d4-a3a2-4a06-b1f6-4f5a57d9129b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:52.543496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53a6d4-a3a2-4a06-b1f6-4f5a57d9129b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:52.545495 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc53a6d4-a3a2-4a06-b1f6-4f5a57d9129b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:52.554509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 530/1075] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:52.560220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53a6d4-a3a2-4a06-b1f6-4f5a57d9129b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:52.619562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b74208-b2f9-4500-8fde-bf9fc120f09b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:52.652357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:52.653937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303fb1b9-30da-44b9-8035-34869fa63948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:52.654602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fb1b9-30da-44b9-8035-34869fa63948 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.654882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fb1b9-30da-44b9-8035-34869fa63948 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.655155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303fb1b9-30da-44b9-8035-34869fa63948 None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/2dbd23de9096446091fb9b7f79f047fc/roles/15a4044f85c94d1eb8032a1fd3c5ed13` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.657332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fb1b9-30da-44b9-8035-34869fa63948 None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=2dbd23de9096446091fb9b7f79f047fc, role_id=15a4044f85c94d1eb8032a1fd3c5ed13)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:52.658788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303fb1b9-30da-44b9-8035-34869fa63948 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:52.662826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc53a6d4-a3a2-4a06-b1f6-4f5a57d9129b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:52.671888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 546/1076] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:52 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/2dbd23de9096446091fb9b7f79f047fc/roles/15a4044f85c94d1eb8032a1fd3c5ed13 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:36:52.673071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2115ca-f9c2-4545-937e-48ec9e5050f2 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.673359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2115ca-f9c2-4545-937e-48ec9e5050f2 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.673677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2115ca-f9c2-4545-937e-48ec9e5050f2 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.674921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 547/1077] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:52.680660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082213-6c2c-44c4-8629-0540a717ba86 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.680956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082213-6c2c-44c4-8629-0540a717ba86 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.681240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac082213-6c2c-44c4-8629-0540a717ba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.700287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67bf0f-3b20-4436-a4fe-03dbdd3d34fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:52.700942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bf0f-3b20-4436-a4fe-03dbdd3d34fa None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.701221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bf0f-3b20-4436-a4fe-03dbdd3d34fa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.701535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c67bf0f-3b20-4436-a4fe-03dbdd3d34fa None admin] PATH_INFO: `/v3/users/d35e00507a794bae9aced18245c4b194` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.701927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ac082213-6c2c-44c4-8629-0540a717ba86 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:52.702788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67bf0f-3b20-4436-a4fe-03dbdd3d34fa None admin] RBAC: Authorizing `identity:get_user(user_id=d35e00507a794bae9aced18245c4b194)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:52.703201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ac082213-6c2c-44c4-8629-0540a717ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:52.704247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c67bf0f-3b20-4436-a4fe-03dbdd3d34fa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:52.710815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 531/1078] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:36:52 2022] GET /identity/v3/users/d35e00507a794bae9aced18245c4b194 => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:52.711823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67bf0f-3b20-4436-a4fe-03dbdd3d34fa None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:52.781578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:52.805520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 548/1079] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:52.841850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c67bf0f-3b20-4436-a4fe-03dbdd3d34fa None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:52.878979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98331b9e-dde5-40be-a2ed-f13fd87ba5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:52.879618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98331b9e-dde5-40be-a2ed-f13fd87ba5ed None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:52.879899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98331b9e-dde5-40be-a2ed-f13fd87ba5ed None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:52.880172 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98331b9e-dde5-40be-a2ed-f13fd87ba5ed None admin] PATH_INFO: `/v3/projects/40efd1b7ca264382b1c6cad10dccc8da` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:52.881295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98331b9e-dde5-40be-a2ed-f13fd87ba5ed None admin] RBAC: Authorizing `identity:get_project(project_id=40efd1b7ca264382b1c6cad10dccc8da)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:52.882764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98331b9e-dde5-40be-a2ed-f13fd87ba5ed None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:52.884563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 532/1080] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:36:52 2022] GET /identity/v3/projects/40efd1b7ca264382b1c6cad10dccc8da => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:52.891197 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082213-6c2c-44c4-8629-0540a717ba86 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:52.993679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac082213-6c2c-44c4-8629-0540a717ba86 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:53.027905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e456b22-f9c8-4ca3-8436-48002cd9fb04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:53.029085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e456b22-f9c8-4ca3-8436-48002cd9fb04 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.029367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e456b22-f9c8-4ca3-8436-48002cd9fb04 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.029686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e456b22-f9c8-4ca3-8436-48002cd9fb04 None admin] PATH_INFO: `/v3/projects/40efd1b7ca264382b1c6cad10dccc8da/users/d35e00507a794bae9aced18245c4b194/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.031652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e456b22-f9c8-4ca3-8436-48002cd9fb04 None admin] RBAC: Authorizing `identity:create_grant(project_id=40efd1b7ca264382b1c6cad10dccc8da, user_id=d35e00507a794bae9aced18245c4b194, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:53.033028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e456b22-f9c8-4ca3-8436-48002cd9fb04 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:53.047954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 549/1081] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:36:52 2022] PUT /identity/v3/projects/40efd1b7ca264382b1c6cad10dccc8da/users/d35e00507a794bae9aced18245c4b194/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:36:53.074166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98331b9e-dde5-40be-a2ed-f13fd87ba5ed None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:53.112489 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:53.197836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98331b9e-dde5-40be-a2ed-f13fd87ba5ed None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:53.239287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39419-5714-4f25-bae1-05838a1bbbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:53.239901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39419-5714-4f25-bae1-05838a1bbbce None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.240177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39419-5714-4f25-bae1-05838a1bbbce None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.240447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a39419-5714-4f25-bae1-05838a1bbbce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.307962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a39419-5714-4f25-bae1-05838a1bbbce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:53.309335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a39419-5714-4f25-bae1-05838a1bbbce None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:53.335865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:53.416420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 533/1082] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:36:53.421587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e456b22-f9c8-4ca3-8436-48002cd9fb04 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:53.474631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:53.535245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e456b22-f9c8-4ca3-8436-48002cd9fb04 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:53.569118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ef131-55c5-4188-bded-93a0506de76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:53.569706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ef131-55c5-4188-bded-93a0506de76a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.569991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ef131-55c5-4188-bded-93a0506de76a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.570345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ef131-55c5-4188-bded-93a0506de76a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.582404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ef131-55c5-4188-bded-93a0506de76a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:53.583950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ef131-55c5-4188-bded-93a0506de76a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-f91ef131-55c5-4188-bded-93a0506de76a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:53.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:53.601336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:53.607319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:53.607319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:53.607319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:53.607319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 550/1083] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:53.609069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39419-5714-4f25-bae1-05838a1bbbce None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:53.708293 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a39419-5714-4f25-bae1-05838a1bbbce None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:53.734265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:53.745398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84f3438-105a-457d-9a79-f899c2c10955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:53.746044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3438-105a-457d-9a79-f899c2c10955 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:53.746323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3438-105a-457d-9a79-f899c2c10955 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:53.747222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84f3438-105a-457d-9a79-f899c2c10955 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:53.747863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3438-105a-457d-9a79-f899c2c10955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:53.748165 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3438-105a-457d-9a79-f899c2c10955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:53.749584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84f3438-105a-457d-9a79-f899c2c10955 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:53.766493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 534/1084] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:54.839760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315e43-3f4b-4819-8b68-a206688e1d93 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.840831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315e43-3f4b-4819-8b68-a206688e1d93 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.840831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd315e43-3f4b-4819-8b68-a206688e1d93 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.842313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 551/1085] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:54.847695 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42412c1-48e9-472d-8e3f-7811476730c6 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:54.848105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42412c1-48e9-472d-8e3f-7811476730c6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:54.848226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42412c1-48e9-472d-8e3f-7811476730c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:54.866582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f42412c1-48e9-472d-8e3f-7811476730c6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:54.867758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f42412c1-48e9-472d-8e3f-7811476730c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:54.932829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 535/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:55.200733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd315e43-3f4b-4819-8b68-a206688e1d93 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.238696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb3be5-b5e4-4ef6-a315-14799f7106f3 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.238984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb3be5-b5e4-4ef6-a315-14799f7106f3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.239264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb3be5-b5e4-4ef6-a315-14799f7106f3 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.240611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 536/1087] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:55.245687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0047f63-12e3-4845-91eb-6c7d1d2148ea None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.245968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0047f63-12e3-4845-91eb-6c7d1d2148ea None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.246242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0047f63-12e3-4845-91eb-6c7d1d2148ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.263942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b0047f63-12e3-4845-91eb-6c7d1d2148ea None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:55.265103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b0047f63-12e3-4845-91eb-6c7d1d2148ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:55.293658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.301362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd315e43-3f4b-4819-8b68-a206688e1d93 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.330852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 537/1088] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:36:55.333989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb883-c254-4564-8d71-79326435a01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.334612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb883-c254-4564-8d71-79326435a01b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.334889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb883-c254-4564-8d71-79326435a01b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.335159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb883-c254-4564-8d71-79326435a01b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.345761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17efb883-c254-4564-8d71-79326435a01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-17efb883-c254-4564-8d71-79326435a01b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:55.350454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:55.353431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:55.354623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 552/1089] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:55.357952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0047f63-12e3-4845-91eb-6c7d1d2148ea None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.404341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.456393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0047f63-12e3-4845-91eb-6c7d1d2148ea None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.490191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed278a-544f-4ffb-b931-7d331bb30e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.490792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed278a-544f-4ffb-b931-7d331bb30e4d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.491067 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed278a-544f-4ffb-b931-7d331bb30e4d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.491336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed278a-544f-4ffb-b931-7d331bb30e4d None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.491988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed278a-544f-4ffb-b931-7d331bb30e4d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:55.492286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed278a-544f-4ffb-b931-7d331bb30e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.493678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed278a-544f-4ffb-b931-7d331bb30e4d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.501322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 538/1090] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:55.507002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb883-c254-4564-8d71-79326435a01b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.597799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed278a-544f-4ffb-b931-7d331bb30e4d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.604639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb883-c254-4564-8d71-79326435a01b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.637987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f43f44-b0e4-4ed5-a2c1-590757e1ab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.638617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f43f44-b0e4-4ed5-a2c1-590757e1ab71 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.638897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f43f44-b0e4-4ed5-a2c1-590757e1ab71 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.639522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f43f44-b0e4-4ed5-a2c1-590757e1ab71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.650657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f43f44-b0e4-4ed5-a2c1-590757e1ab71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.652082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f43f44-b0e4-4ed5-a2c1-590757e1ab71 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-10f43f44-b0e4-4ed5-a2c1-590757e1ab71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:55.666090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:55.667083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:55.667977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:55.667977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:55.667977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:55.667977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 553/1091] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:55.673335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f43f44-b0e4-4ed5-a2c1-590757e1ab71 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.682191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.697823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed278a-544f-4ffb-b931-7d331bb30e4d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.706488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.732573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c9953-23dd-4faa-86c2-2eaff2425396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.733203 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c9953-23dd-4faa-86c2-2eaff2425396 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.733509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c9953-23dd-4faa-86c2-2eaff2425396 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.733783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c9953-23dd-4faa-86c2-2eaff2425396 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.745575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47c9953-23dd-4faa-86c2-2eaff2425396 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-b47c9953-23dd-4faa-86c2-2eaff2425396 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:36:55.750354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:55.751491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:55.752508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 539/1092] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:55.757232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c9953-23dd-4faa-86c2-2eaff2425396 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.776753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f43f44-b0e4-4ed5-a2c1-590757e1ab71 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.811251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cef625-bf14-4cc0-883d-d94f7fe908bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.811851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cef625-bf14-4cc0-883d-d94f7fe908bc None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.812137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cef625-bf14-4cc0-883d-d94f7fe908bc None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.812407 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cef625-bf14-4cc0-883d-d94f7fe908bc None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.813043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cef625-bf14-4cc0-883d-d94f7fe908bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:55.813344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cef625-bf14-4cc0-883d-d94f7fe908bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.814722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cef625-bf14-4cc0-883d-d94f7fe908bc None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.826828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 554/1093] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:55.832431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cef625-bf14-4cc0-883d-d94f7fe908bc None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.854822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c9953-23dd-4faa-86c2-2eaff2425396 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.886558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3757317-3c41-44d5-b7ba-692532406773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.887666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3757317-3c41-44d5-b7ba-692532406773 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.887942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3757317-3c41-44d5-b7ba-692532406773 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.888215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3757317-3c41-44d5-b7ba-692532406773 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.888860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3757317-3c41-44d5-b7ba-692532406773 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:55.889156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3757317-3c41-44d5-b7ba-692532406773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.890537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3757317-3c41-44d5-b7ba-692532406773 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.896093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.899651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 540/1094] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:55.905927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3757317-3c41-44d5-b7ba-692532406773 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:55.930834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cef625-bf14-4cc0-883d-d94f7fe908bc None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:55.935939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:55.965800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61653123-b65b-4e57-8bd0-44fa1416bf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:55.966354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61653123-b65b-4e57-8bd0-44fa1416bf3d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:55.966631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61653123-b65b-4e57-8bd0-44fa1416bf3d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:55.966900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61653123-b65b-4e57-8bd0-44fa1416bf3d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:55.973955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61653123-b65b-4e57-8bd0-44fa1416bf3d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:55.975389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61653123-b65b-4e57-8bd0-44fa1416bf3d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-61653123-b65b-4e57-8bd0-44fa1416bf3d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:36:55.987332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:55.988540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:55.989745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 555/1095] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:55.994791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61653123-b65b-4e57-8bd0-44fa1416bf3d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:56.010306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3757317-3c41-44d5-b7ba-692532406773 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:56.044997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab33f9f-c954-441a-a64f-8255d41e338f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:56.045657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab33f9f-c954-441a-a64f-8255d41e338f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.045934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab33f9f-c954-441a-a64f-8255d41e338f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.046373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab33f9f-c954-441a-a64f-8255d41e338f None admin] PATH_INFO: `/v3/users/d35e00507a794bae9aced18245c4b194` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.047324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab33f9f-c954-441a-a64f-8255d41e338f None admin] RBAC: Authorizing `identity:get_user(user_id=d35e00507a794bae9aced18245c4b194)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:56.048753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab33f9f-c954-441a-a64f-8255d41e338f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:56.050367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 541/1096] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/users/d35e00507a794bae9aced18245c4b194 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:56.055939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab33f9f-c954-441a-a64f-8255d41e338f None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:56.095134 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61653123-b65b-4e57-8bd0-44fa1416bf3d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:56.119373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:56.128850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667076c-9c25-4cf0-9853-c129ed685fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:56.129485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667076c-9c25-4cf0-9853-c129ed685fc0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.129775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667076c-9c25-4cf0-9853-c129ed685fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.130049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0667076c-9c25-4cf0-9853-c129ed685fc0 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.130776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667076c-9c25-4cf0-9853-c129ed685fc0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:56.131081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667076c-9c25-4cf0-9853-c129ed685fc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:56.132528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0667076c-9c25-4cf0-9853-c129ed685fc0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:56.149017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 556/1097] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 17 00:36:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:56.150188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:56.155089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab33f9f-c954-441a-a64f-8255d41e338f None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:56.155310 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667076c-9c25-4cf0-9853-c129ed685fc0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:56.189234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bf76d-f274-454b-9d1f-a212b7749f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:56.189866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bf76d-f274-454b-9d1f-a212b7749f75 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.190140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bf76d-f274-454b-9d1f-a212b7749f75 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.190409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95bf76d-f274-454b-9d1f-a212b7749f75 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.252443 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0667076c-9c25-4cf0-9853-c129ed685fc0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:56.255936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bf76d-f274-454b-9d1f-a212b7749f75 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:56.257380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95bf76d-f274-454b-9d1f-a212b7749f75 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:56.285135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab25da-ca57-4782-8d2e-483e80781f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:56.285762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab25da-ca57-4782-8d2e-483e80781f70 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.286039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab25da-ca57-4782-8d2e-483e80781f70 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.286305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab25da-ca57-4782-8d2e-483e80781f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.336958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:56.349752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:56.354195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab25da-ca57-4782-8d2e-483e80781f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:56.355642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab25da-ca57-4782-8d2e-483e80781f70 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:56.355795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 542/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 00:36:56.361520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bf76d-f274-454b-9d1f-a212b7749f75 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:56.451989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 557/1099] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:36:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 17 00:36:56.457027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95bf76d-f274-454b-9d1f-a212b7749f75 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:56.457782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab25da-ca57-4782-8d2e-483e80781f70 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:56.491537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f0b4f-f93a-4d84-a60e-d15b286e44eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:56.492156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f0b4f-f93a-4d84-a60e-d15b286e44eb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.492457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f0b4f-f93a-4d84-a60e-d15b286e44eb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.492729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047f0b4f-f93a-4d84-a60e-d15b286e44eb None admin] PATH_INFO: `/v3/projects/40efd1b7ca264382b1c6cad10dccc8da` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.493850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f0b4f-f93a-4d84-a60e-d15b286e44eb None admin] RBAC: Authorizing `identity:get_project(project_id=40efd1b7ca264382b1c6cad10dccc8da)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:56.495273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047f0b4f-f93a-4d84-a60e-d15b286e44eb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:56.497378 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 543/1100] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:36:56 2022] GET /identity/v3/projects/40efd1b7ca264382b1c6cad10dccc8da => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:56.503265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f0b4f-f93a-4d84-a60e-d15b286e44eb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:56.538052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:56.554086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab25da-ca57-4782-8d2e-483e80781f70 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:56.566277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:56.587590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e968-e20b-4f2c-af86-96966adcf2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:56.588209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e968-e20b-4f2c-af86-96966adcf2d4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.588750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e968-e20b-4f2c-af86-96966adcf2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.589018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d498e968-e20b-4f2c-af86-96966adcf2d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.599250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498e968-e20b-4f2c-af86-96966adcf2d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:56.600161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047f0b4f-f93a-4d84-a60e-d15b286e44eb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:56.600673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d498e968-e20b-4f2c-af86-96966adcf2d4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-d498e968-e20b-4f2c-af86-96966adcf2d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:36:56.616206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:56.617176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:36:56.618124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:36:56.618124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:36:56.618124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:36:56.618124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 558/1101] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:36:56.623175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e968-e20b-4f2c-af86-96966adcf2d4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:56.636441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0a09-b120-4522-928c-b00336ed6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:56.637559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0a09-b120-4522-928c-b00336ed6614 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.637846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0a09-b120-4522-928c-b00336ed6614 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.638123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f0a09-b120-4522-928c-b00336ed6614 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.638845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0a09-b120-4522-928c-b00336ed6614 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=40efd1b7ca264382b1c6cad10dccc8da, user.id=d35e00507a794bae9aced18245c4b194) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:56.639153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0a09-b120-4522-928c-b00336ed6614 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:56.640579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f0a09-b120-4522-928c-b00336ed6614 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:56.646389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 544/1102] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:56 2022] GET /identity/v3/role_assignments?user.id=d35e00507a794bae9aced18245c4b194&scope.project.id=40efd1b7ca264382b1c6cad10dccc8da&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:56.725962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d498e968-e20b-4f2c-af86-96966adcf2d4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:56.759829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c5bb-feb1-4b87-bcf0-ff77ce7557ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:56.760355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c5bb-feb1-4b87-bcf0-ff77ce7557ce None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.760632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c5bb-feb1-4b87-bcf0-ff77ce7557ce None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.760900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323c5bb-feb1-4b87-bcf0-ff77ce7557ce None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.761649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c5bb-feb1-4b87-bcf0-ff77ce7557ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:56.761950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c5bb-feb1-4b87-bcf0-ff77ce7557ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:56.763862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323c5bb-feb1-4b87-bcf0-ff77ce7557ce None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:56.766588 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:56.777152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 559/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:36:56.783929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0a09-b120-4522-928c-b00336ed6614 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:56.885573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f0a09-b120-4522-928c-b00336ed6614 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:56.913479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:56.920586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb107f6-4153-4bce-96b5-b7d5491407b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:56.921212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb107f6-4153-4bce-96b5-b7d5491407b0 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:56.921519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb107f6-4153-4bce-96b5-b7d5491407b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:56.921787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb107f6-4153-4bce-96b5-b7d5491407b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:56.928326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb107f6-4153-4bce-96b5-b7d5491407b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:56.929793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb107f6-4153-4bce-96b5-b7d5491407b0 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-8fb107f6-4153-4bce-96b5-b7d5491407b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:36:56.940838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:36:56.941976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:36:56.942968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:36:56.942968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:36:56.942968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:36:56.942968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:36:56.942968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:36:56.942968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:36:56.942968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:36:56.942968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:36:56.943779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 545/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:36:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:36:56.947889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c5bb-feb1-4b87-bcf0-ff77ce7557ce None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:57.045572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323c5bb-feb1-4b87-bcf0-ff77ce7557ce None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:57.077839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7a9ce-147c-43e1-b8d0-e708fab91cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:57.078441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7a9ce-147c-43e1-b8d0-e708fab91cb6 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:57.078716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7a9ce-147c-43e1-b8d0-e708fab91cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:57.078986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7a9ce-147c-43e1-b8d0-e708fab91cb6 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:57.079668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7a9ce-147c-43e1-b8d0-e708fab91cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:57.079969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7a9ce-147c-43e1-b8d0-e708fab91cb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:57.081373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7a9ce-147c-43e1-b8d0-e708fab91cb6 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:57.093228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 560/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:36:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:57.099372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb107f6-4153-4bce-96b5-b7d5491407b0 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:57.196552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb107f6-4153-4bce-96b5-b7d5491407b0 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:57.229448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c3fedc-fb04-4a46-b1a5-3f639584f914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:57.230053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3fedc-fb04-4a46-b1a5-3f639584f914 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:57.230330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3fedc-fb04-4a46-b1a5-3f639584f914 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:57.230601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c3fedc-fb04-4a46-b1a5-3f639584f914 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:57.231921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3fedc-fb04-4a46-b1a5-3f639584f914 None admin] RBAC: Adding query filter params (role.id=15a4044f85c94d1eb8032a1fd3c5ed13, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=2dbd23de9096446091fb9b7f79f047fc) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:36:57.232225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3fedc-fb04-4a46-b1a5-3f639584f914 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:57.233680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c3fedc-fb04-4a46-b1a5-3f639584f914 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:57.239325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 546/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:36:57 2022] GET /identity/v3/role_assignments?user.id=2dbd23de9096446091fb9b7f79f047fc&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=15a4044f85c94d1eb8032a1fd3c5ed13 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:58.816376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92165404-8e10-4a8b-889f-9c998ca3f238 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:58.816902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92165404-8e10-4a8b-889f-9c998ca3f238 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:58.816902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92165404-8e10-4a8b-889f-9c998ca3f238 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:58.818294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 561/1107] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:36:58.823370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675340-a487-49cc-b1cc-23991f95ca93 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:58.823807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675340-a487-49cc-b1cc-23991f95ca93 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:58.823913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6675340-a487-49cc-b1cc-23991f95ca93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:58.841863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e6675340-a487-49cc-b1cc-23991f95ca93 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:36:58.843024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e6675340-a487-49cc-b1cc-23991f95ca93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:36:58.889968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:58.906755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 547/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:36:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:36:59.176925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92165404-8e10-4a8b-889f-9c998ca3f238 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:59.232428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:36:59.275883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92165404-8e10-4a8b-889f-9c998ca3f238 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:59.307856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6302ac6b-1f56-4915-a6de-0a6406d3e80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:59.308463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302ac6b-1f56-4915-a6de-0a6406d3e80f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:59.308737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302ac6b-1f56-4915-a6de-0a6406d3e80f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:59.309568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6302ac6b-1f56-4915-a6de-0a6406d3e80f None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:59.310649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302ac6b-1f56-4915-a6de-0a6406d3e80f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:59.312051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6302ac6b-1f56-4915-a6de-0a6406d3e80f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:59.313597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 562/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:36:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:36:59.319130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675340-a487-49cc-b1cc-23991f95ca93 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:36:59.413702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6675340-a487-49cc-b1cc-23991f95ca93 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:36:59.446972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c113b6a-7f12-4d03-8916-e238da9e3c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:36:59.447513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c113b6a-7f12-4d03-8916-e238da9e3c5c None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:36:59.447791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c113b6a-7f12-4d03-8916-e238da9e3c5c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:36:59.448062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c113b6a-7f12-4d03-8916-e238da9e3c5c None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:36:59.448720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c113b6a-7f12-4d03-8916-e238da9e3c5c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:36:59.450799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c113b6a-7f12-4d03-8916-e238da9e3c5c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:36:59.471946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 548/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:36:59 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:01.641729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9e83-2756-4a09-8de4-7885b2889961 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:01.642281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9e83-2756-4a09-8de4-7885b2889961 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:01.642281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c9e83-2756-4a09-8de4-7885b2889961 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:01.643592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 563/1111] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:01.648808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f275e-ea5d-4b56-bf65-daa0ce7980ae None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:01.649224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f275e-ea5d-4b56-bf65-daa0ce7980ae None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:01.649350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6f275e-ea5d-4b56-bf65-daa0ce7980ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:01.667599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-db6f275e-ea5d-4b56-bf65-daa0ce7980ae None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:01.668703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-db6f275e-ea5d-4b56-bf65-daa0ce7980ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:01.701819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:01.733420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 549/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:02.007354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9e83-2756-4a09-8de4-7885b2889961 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:02.106657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c9e83-2756-4a09-8de4-7885b2889961 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:02.128676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:02.139388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e06c52-4fbe-4514-b149-1081d3a1314a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:02.140004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e06c52-4fbe-4514-b149-1081d3a1314a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:02.140279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e06c52-4fbe-4514-b149-1081d3a1314a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:02.140550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e06c52-4fbe-4514-b149-1081d3a1314a None admin] PATH_INFO: `/v3/roles/1f5abd9c8afd411ebac7cd79bb5f1230` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:02.141937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e06c52-4fbe-4514-b149-1081d3a1314a None admin] RBAC: Authorizing `identity:get_role(role_id=1f5abd9c8afd411ebac7cd79bb5f1230)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:02.143287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e06c52-4fbe-4514-b149-1081d3a1314a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:02.144589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 564/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:02 2022] GET /identity/v3/roles/1f5abd9c8afd411ebac7cd79bb5f1230 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:37:02.150370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f275e-ea5d-4b56-bf65-daa0ce7980ae None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:02.245490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6f275e-ea5d-4b56-bf65-daa0ce7980ae None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:02.277437 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160746-e78e-4160-989b-b812bce7720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:02.278540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160746-e78e-4160-989b-b812bce7720c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:02.278817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160746-e78e-4160-989b-b812bce7720c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:02.279087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d160746-e78e-4160-989b-b812bce7720c None admin] PATH_INFO: `/v3/users/824345cef6b5499cb9fd35851ae0eb18` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:02.291506 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d160746-e78e-4160-989b-b812bce7720c None admin] RBAC: Authorizing `identity:get_user(user_id=824345cef6b5499cb9fd35851ae0eb18)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:02.292935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d160746-e78e-4160-989b-b812bce7720c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:02.295086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 550/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:02 2022] GET /identity/v3/users/824345cef6b5499cb9fd35851ae0eb18 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:02.300627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e06c52-4fbe-4514-b149-1081d3a1314a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:02.394586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e06c52-4fbe-4514-b149-1081d3a1314a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:02.426758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a25fe-b728-4186-b7c2-9f82f7d83112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:02.427355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a25fe-b728-4186-b7c2-9f82f7d83112 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:02.427631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a25fe-b728-4186-b7c2-9f82f7d83112 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:02.427900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a25fe-b728-4186-b7c2-9f82f7d83112 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:02.483308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:02.492807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a25fe-b728-4186-b7c2-9f82f7d83112 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:02.494269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87a25fe-b728-4186-b7c2-9f82f7d83112 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:02.586026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 565/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:02.592115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160746-e78e-4160-989b-b812bce7720c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:02.619350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:02.688831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d160746-e78e-4160-989b-b812bce7720c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:02.720822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5431c6b-7ca0-4360-bc7f-6db1dc541b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:02.721452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5431c6b-7ca0-4360-bc7f-6db1dc541b11 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:02.721732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5431c6b-7ca0-4360-bc7f-6db1dc541b11 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:02.722003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5431c6b-7ca0-4360-bc7f-6db1dc541b11 None admin] PATH_INFO: `/v3/projects/40efd1b7ca264382b1c6cad10dccc8da` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:02.723098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5431c6b-7ca0-4360-bc7f-6db1dc541b11 None admin] RBAC: Authorizing `identity:get_project(project_id=40efd1b7ca264382b1c6cad10dccc8da)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:02.724522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5431c6b-7ca0-4360-bc7f-6db1dc541b11 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:02.726138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 551/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:02 2022] GET /identity/v3/projects/40efd1b7ca264382b1c6cad10dccc8da => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:02.732774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a25fe-b728-4186-b7c2-9f82f7d83112 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:02.817997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:02.827064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a25fe-b728-4186-b7c2-9f82f7d83112 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:02.859218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fac9ef-b818-447e-96ab-9ddeb97eebcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:02.859745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fac9ef-b818-447e-96ab-9ddeb97eebcc None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:02.860020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fac9ef-b818-447e-96ab-9ddeb97eebcc None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:02.860290 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fac9ef-b818-447e-96ab-9ddeb97eebcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:02.860997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fac9ef-b818-447e-96ab-9ddeb97eebcc None admin] RBAC: Adding query filter params (role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=40efd1b7ca264382b1c6cad10dccc8da, user.id=824345cef6b5499cb9fd35851ae0eb18) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:02.861301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fac9ef-b818-447e-96ab-9ddeb97eebcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:02.862841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fac9ef-b818-447e-96ab-9ddeb97eebcc None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:02.867913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 566/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:02 2022] GET /identity/v3/role_assignments?user.id=824345cef6b5499cb9fd35851ae0eb18&scope.project.id=40efd1b7ca264382b1c6cad10dccc8da&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:04.934356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7513b-b179-47ac-9bb4-a2053bc8431b None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:04.934903 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7513b-b179-47ac-9bb4-a2053bc8431b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:04.935012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd7513b-b179-47ac-9bb4-a2053bc8431b None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:04.936264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 552/1118] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:04.941260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522689-39af-415c-a652-ae250054347f None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:04.941692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522689-39af-415c-a652-ae250054347f None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:04.941850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17522689-39af-415c-a652-ae250054347f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:04.959904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-17522689-39af-415c-a652-ae250054347f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:04.961068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-17522689-39af-415c-a652-ae250054347f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:05.024361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 567/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:37:05.293816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7513b-b179-47ac-9bb4-a2053bc8431b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:05.384282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:05.391195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd7513b-b179-47ac-9bb4-a2053bc8431b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:05.426748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01967b-1b73-43d3-8285-d1ca3dfb6c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:05.427379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01967b-1b73-43d3-8285-d1ca3dfb6c08 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:05.427656 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01967b-1b73-43d3-8285-d1ca3dfb6c08 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:05.427926 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be01967b-1b73-43d3-8285-d1ca3dfb6c08 None admin] PATH_INFO: `/v3/roles/1f5abd9c8afd411ebac7cd79bb5f1230` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:05.429313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01967b-1b73-43d3-8285-d1ca3dfb6c08 None admin] RBAC: Authorizing `identity:get_role(role_id=1f5abd9c8afd411ebac7cd79bb5f1230)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:05.430705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be01967b-1b73-43d3-8285-d1ca3dfb6c08 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:05.432011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 553/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:05 2022] GET /identity/v3/roles/1f5abd9c8afd411ebac7cd79bb5f1230 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:05.437734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522689-39af-415c-a652-ae250054347f None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:05.517589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:05.532856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17522689-39af-415c-a652-ae250054347f None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:05.564138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa59723-dd6f-48f1-a64c-cbd91d32be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:05.564693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa59723-dd6f-48f1-a64c-cbd91d32be9f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:05.564969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa59723-dd6f-48f1-a64c-cbd91d32be9f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:05.565238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa59723-dd6f-48f1-a64c-cbd91d32be9f None admin] PATH_INFO: `/v3/users/824345cef6b5499cb9fd35851ae0eb18` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:05.566357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa59723-dd6f-48f1-a64c-cbd91d32be9f None admin] RBAC: Authorizing `identity:get_user(user_id=824345cef6b5499cb9fd35851ae0eb18)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:05.567762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa59723-dd6f-48f1-a64c-cbd91d32be9f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:05.569298 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 568/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:05 2022] GET /identity/v3/users/824345cef6b5499cb9fd35851ae0eb18 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:05.575639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01967b-1b73-43d3-8285-d1ca3dfb6c08 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:05.671314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be01967b-1b73-43d3-8285-d1ca3dfb6c08 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:05.703569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c2eba4-b109-4e92-a859-ebe7b82e6bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:05.704177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2eba4-b109-4e92-a859-ebe7b82e6bef None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:05.704454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2eba4-b109-4e92-a859-ebe7b82e6bef None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:05.704724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c2eba4-b109-4e92-a859-ebe7b82e6bef None admin] PATH_INFO: `/v3/projects/40efd1b7ca264382b1c6cad10dccc8da` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:05.705841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2eba4-b109-4e92-a859-ebe7b82e6bef None admin] RBAC: Authorizing `identity:get_project(project_id=40efd1b7ca264382b1c6cad10dccc8da)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:05.707263 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c2eba4-b109-4e92-a859-ebe7b82e6bef None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:05.708842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 554/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:05 2022] GET /identity/v3/projects/40efd1b7ca264382b1c6cad10dccc8da => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:05.714937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa59723-dd6f-48f1-a64c-cbd91d32be9f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:05.808224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa59723-dd6f-48f1-a64c-cbd91d32be9f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:05.840916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98103c-f9ea-4791-8934-54085e2de3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:05.841518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98103c-f9ea-4791-8934-54085e2de3de None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:05.841797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98103c-f9ea-4791-8934-54085e2de3de None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:05.842068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98103c-f9ea-4791-8934-54085e2de3de None admin] PATH_INFO: `/v3/projects/40efd1b7ca264382b1c6cad10dccc8da/users/824345cef6b5499cb9fd35851ae0eb18/roles/1f5abd9c8afd411ebac7cd79bb5f1230` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:05.844144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98103c-f9ea-4791-8934-54085e2de3de None admin] RBAC: Authorizing `identity:create_grant(project_id=40efd1b7ca264382b1c6cad10dccc8da, user_id=824345cef6b5499cb9fd35851ae0eb18, role_id=1f5abd9c8afd411ebac7cd79bb5f1230)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:05.845608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d98103c-f9ea-4791-8934-54085e2de3de None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:05.858043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 569/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:37:05 2022] PUT /identity/v3/projects/40efd1b7ca264382b1c6cad10dccc8da/users/824345cef6b5499cb9fd35851ae0eb18/roles/1f5abd9c8afd411ebac7cd79bb5f1230 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:37:07.967731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be901495-5512-4a02-a92c-00de506f85d8 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:07.968257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be901495-5512-4a02-a92c-00de506f85d8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:07.968257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be901495-5512-4a02-a92c-00de506f85d8 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:07.969625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 555/1124] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:07.974709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65bca-592e-4091-8640-8c50e3ecc229 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:07.975123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65bca-592e-4091-8640-8c50e3ecc229 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:07.975261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d65bca-592e-4091-8640-8c50e3ecc229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:07.992941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b1d65bca-592e-4091-8640-8c50e3ecc229 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:07.994167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b1d65bca-592e-4091-8640-8c50e3ecc229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:08.003089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:08.059461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 570/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:08.330351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be901495-5512-4a02-a92c-00de506f85d8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:08.360329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:08.427887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be901495-5512-4a02-a92c-00de506f85d8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:08.462331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8711521-2134-4540-be41-25fa8782252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:08.462957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8711521-2134-4540-be41-25fa8782252e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:08.463242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8711521-2134-4540-be41-25fa8782252e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:08.463778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8711521-2134-4540-be41-25fa8782252e None admin] PATH_INFO: `/v3/roles/1f5abd9c8afd411ebac7cd79bb5f1230` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:08.465166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8711521-2134-4540-be41-25fa8782252e None admin] RBAC: Authorizing `identity:get_role(role_id=1f5abd9c8afd411ebac7cd79bb5f1230)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:08.466575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8711521-2134-4540-be41-25fa8782252e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:08.467895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 556/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:08 2022] GET /identity/v3/roles/1f5abd9c8afd411ebac7cd79bb5f1230 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:08.473697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65bca-592e-4091-8640-8c50e3ecc229 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:08.576835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d65bca-592e-4091-8640-8c50e3ecc229 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:08.609121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4a829-7d6c-4516-b32a-29c555e3ab05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:08.609705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4a829-7d6c-4516-b32a-29c555e3ab05 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:08.609982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4a829-7d6c-4516-b32a-29c555e3ab05 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:08.610254 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4a829-7d6c-4516-b32a-29c555e3ab05 None admin] PATH_INFO: `/v3/users/824345cef6b5499cb9fd35851ae0eb18` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:08.611361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4a829-7d6c-4516-b32a-29c555e3ab05 None admin] RBAC: Authorizing `identity:get_user(user_id=824345cef6b5499cb9fd35851ae0eb18)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:08.612770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a4a829-7d6c-4516-b32a-29c555e3ab05 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:08.614362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 571/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:08 2022] GET /identity/v3/users/824345cef6b5499cb9fd35851ae0eb18 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:08.620417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8711521-2134-4540-be41-25fa8782252e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:08.712082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:08.715477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8711521-2134-4540-be41-25fa8782252e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:08.748513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b943-7791-4083-828d-1e7ae6b5edec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:08.749095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b943-7791-4083-828d-1e7ae6b5edec None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:08.749371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b943-7791-4083-828d-1e7ae6b5edec None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:08.749674 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5121b943-7791-4083-828d-1e7ae6b5edec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:08.815653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121b943-7791-4083-828d-1e7ae6b5edec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:08.817099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5121b943-7791-4083-828d-1e7ae6b5edec None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:08.907381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:08.913543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 557/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:08.917537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4a829-7d6c-4516-b32a-29c555e3ab05 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:08.932317 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:09.014021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4a829-7d6c-4516-b32a-29c555e3ab05 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:09.046641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912abc64-6d66-4f75-b6fd-9985cf2928a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:09.047252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912abc64-6d66-4f75-b6fd-9985cf2928a5 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:09.047531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912abc64-6d66-4f75-b6fd-9985cf2928a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:09.047804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912abc64-6d66-4f75-b6fd-9985cf2928a5 None admin] PATH_INFO: `/v3/projects/40efd1b7ca264382b1c6cad10dccc8da` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:09.048894 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912abc64-6d66-4f75-b6fd-9985cf2928a5 None admin] RBAC: Authorizing `identity:get_project(project_id=40efd1b7ca264382b1c6cad10dccc8da)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:09.050334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912abc64-6d66-4f75-b6fd-9985cf2928a5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:09.051933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 572/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:08 2022] GET /identity/v3/projects/40efd1b7ca264382b1c6cad10dccc8da => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:09.057915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b943-7791-4083-828d-1e7ae6b5edec None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:09.157366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5121b943-7791-4083-828d-1e7ae6b5edec None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:09.190219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b992ae-8438-4a5b-8949-db47dcb491c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:09.190754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b992ae-8438-4a5b-8949-db47dcb491c3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:09.191031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b992ae-8438-4a5b-8949-db47dcb491c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:09.191302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b992ae-8438-4a5b-8949-db47dcb491c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:09.192023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b992ae-8438-4a5b-8949-db47dcb491c3 None admin] RBAC: Adding query filter params (role.id=1f5abd9c8afd411ebac7cd79bb5f1230, scope.project.id=40efd1b7ca264382b1c6cad10dccc8da, user.id=824345cef6b5499cb9fd35851ae0eb18) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:09.192331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b992ae-8438-4a5b-8949-db47dcb491c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:09.193778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b992ae-8438-4a5b-8949-db47dcb491c3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:09.199975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 558/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:09 2022] GET /identity/v3/role_assignments?user.id=824345cef6b5499cb9fd35851ae0eb18&scope.project.id=40efd1b7ca264382b1c6cad10dccc8da&role.id=1f5abd9c8afd411ebac7cd79bb5f1230 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:11.328033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c50c-7f49-42c6-81ed-e88770831fe9 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:11.328560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c50c-7f49-42c6-81ed-e88770831fe9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:11.328560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7c50c-7f49-42c6-81ed-e88770831fe9 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:11.329958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 573/1131] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:11.335361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604d7a4-4134-4cf1-a4b1-de8680a92406 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:11.335742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604d7a4-4134-4cf1-a4b1-de8680a92406 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:11.335917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b604d7a4-4134-4cf1-a4b1-de8680a92406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:11.354365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b604d7a4-4134-4cf1-a4b1-de8680a92406 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:11.356131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b604d7a4-4134-4cf1-a4b1-de8680a92406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:11.411991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:11.421372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 559/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:11.692376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c50c-7f49-42c6-81ed-e88770831fe9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:11.769664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:11.788865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7c50c-7f49-42c6-81ed-e88770831fe9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:11.821486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5873a3e-b3a6-4e6a-86bd-ac7274eb8d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:11.822112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5873a3e-b3a6-4e6a-86bd-ac7274eb8d9c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:11.822393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5873a3e-b3a6-4e6a-86bd-ac7274eb8d9c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:11.822672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5873a3e-b3a6-4e6a-86bd-ac7274eb8d9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:11.823782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5873a3e-b3a6-4e6a-86bd-ac7274eb8d9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:11.825209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5873a3e-b3a6-4e6a-86bd-ac7274eb8d9c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:11.826831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 574/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:37:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:11.832424 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604d7a4-4134-4cf1-a4b1-de8680a92406 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:11.929615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b604d7a4-4134-4cf1-a4b1-de8680a92406 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:11.961662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348a6cfc-9e38-4a33-9117-c276dd99f5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:11.962206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6cfc-9e38-4a33-9117-c276dd99f5da None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:11.962487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6cfc-9e38-4a33-9117-c276dd99f5da None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:11.962760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348a6cfc-9e38-4a33-9117-c276dd99f5da None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:11.963675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a6cfc-9e38-4a33-9117-c276dd99f5da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:11.965679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348a6cfc-9e38-4a33-9117-c276dd99f5da None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:11.993559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 560/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:37:11 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:14.129740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7524c5-7b59-4e70-9c51-599152f9e825 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:14.130277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7524c5-7b59-4e70-9c51-599152f9e825 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:14.130277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7524c5-7b59-4e70-9c51-599152f9e825 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:14.133015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 575/1135] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:14.139187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1a907-77e8-4f20-9c22-27b1bd6f94bb None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:14.139697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1a907-77e8-4f20-9c22-27b1bd6f94bb None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:14.139852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f1a907-77e8-4f20-9c22-27b1bd6f94bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:14.158685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a9f1a907-77e8-4f20-9c22-27b1bd6f94bb None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:14.159865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a9f1a907-77e8-4f20-9c22-27b1bd6f94bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:14.199945 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:14.225465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 561/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:37:14.496446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7524c5-7b59-4e70-9c51-599152f9e825 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:14.594002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7524c5-7b59-4e70-9c51-599152f9e825 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:14.625144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3dea3-2607-40cb-b825-69ac2a3ea309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:14.625782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3dea3-2607-40cb-b825-69ac2a3ea309 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:14.626057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3dea3-2607-40cb-b825-69ac2a3ea309 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:14.626324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3dea3-2607-40cb-b825-69ac2a3ea309 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:14.627395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3dea3-2607-40cb-b825-69ac2a3ea309 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:14.628801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3dea3-2607-40cb-b825-69ac2a3ea309 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:14.630357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 576/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:14.635821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1a907-77e8-4f20-9c22-27b1bd6f94bb None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:14.731498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f1a907-77e8-4f20-9c22-27b1bd6f94bb None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:14.763824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d22e47-73ed-498a-b855-d77d9d2f7100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:14.764419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22e47-73ed-498a-b855-d77d9d2f7100 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:14.764697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22e47-73ed-498a-b855-d77d9d2f7100 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:14.764970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d22e47-73ed-498a-b855-d77d9d2f7100 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:14.765649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d22e47-73ed-498a-b855-d77d9d2f7100 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:14.767064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d22e47-73ed-498a-b855-d77d9d2f7100 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:14.787382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 562/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:37:14 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:37:16.942155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb447e-66d2-46ac-8e44-2db4f13baed9 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:16.942703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb447e-66d2-46ac-8e44-2db4f13baed9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:16.942703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb447e-66d2-46ac-8e44-2db4f13baed9 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:16.944014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 577/1139] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:16.949367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede4b60-bbc0-4199-b5cc-cb2fee8f7b13 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:16.949802 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede4b60-bbc0-4199-b5cc-cb2fee8f7b13 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:16.949942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fede4b60-bbc0-4199-b5cc-cb2fee8f7b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:16.967769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-fede4b60-bbc0-4199-b5cc-cb2fee8f7b13 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:16.968937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-fede4b60-bbc0-4199-b5cc-cb2fee8f7b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:16.994680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:17.035036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 563/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:17.318354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb447e-66d2-46ac-8e44-2db4f13baed9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:17.336361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:17.416149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb447e-66d2-46ac-8e44-2db4f13baed9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:17.448668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52a35e-b66d-406e-8fae-5b251edd37cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:17.449837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a35e-b66d-406e-8fae-5b251edd37cb None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:17.450111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a35e-b66d-406e-8fae-5b251edd37cb None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:17.450380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52a35e-b66d-406e-8fae-5b251edd37cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:17.459925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52a35e-b66d-406e-8fae-5b251edd37cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-7e52a35e-b66d-406e-8fae-5b251edd37cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:17.464879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:17.466008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:37:17.467054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 578/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:17.471844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede4b60-bbc0-4199-b5cc-cb2fee8f7b13 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:17.565417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fede4b60-bbc0-4199-b5cc-cb2fee8f7b13 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:17.598158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0988b-73a4-4779-846c-db21dc4b80bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:17.598685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0988b-73a4-4779-846c-db21dc4b80bc None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:17.598959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0988b-73a4-4779-846c-db21dc4b80bc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:17.599229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0988b-73a4-4779-846c-db21dc4b80bc None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:17.599880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0988b-73a4-4779-846c-db21dc4b80bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:17.600179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0988b-73a4-4779-846c-db21dc4b80bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:17.601572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0988b-73a4-4779-846c-db21dc4b80bc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:17.609131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 564/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:17.614746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52a35e-b66d-406e-8fae-5b251edd37cb None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:17.687544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:17.709771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52a35e-b66d-406e-8fae-5b251edd37cb None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:17.741911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ab00-89cf-4102-99bf-5fd439d9c838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:17.742513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ab00-89cf-4102-99bf-5fd439d9c838 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:17.742788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ab00-89cf-4102-99bf-5fd439d9c838 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:17.743056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ab00-89cf-4102-99bf-5fd439d9c838 None admin] PATH_INFO: `/v3/users/2da1c4551475424c9805c058d7be1e60` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:17.755381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9ab00-89cf-4102-99bf-5fd439d9c838 None admin] RBAC: Authorizing `identity:get_user(user_id=2da1c4551475424c9805c058d7be1e60)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:17.756786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9ab00-89cf-4102-99bf-5fd439d9c838 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:17.758356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 579/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:17 2022] GET /identity/v3/users/2da1c4551475424c9805c058d7be1e60 => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:17.764417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0988b-73a4-4779-846c-db21dc4b80bc None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:17.789261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:17.860619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0988b-73a4-4779-846c-db21dc4b80bc None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:17.892992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d9318-2b90-439a-b228-964b8a02a348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:17.893602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d9318-2b90-439a-b228-964b8a02a348 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:17.893878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d9318-2b90-439a-b228-964b8a02a348 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:17.894151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342d9318-2b90-439a-b228-964b8a02a348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:17.959004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d9318-2b90-439a-b228-964b8a02a348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:17.960431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342d9318-2b90-439a-b228-964b8a02a348 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:17.982794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:18.053710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 565/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:18.060072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ab00-89cf-4102-99bf-5fd439d9c838 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:18.157001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9ab00-89cf-4102-99bf-5fd439d9c838 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:18.191132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44475a0c-abe2-470b-ad2f-aabe4be889c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:18.191754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44475a0c-abe2-470b-ad2f-aabe4be889c2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:18.192034 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44475a0c-abe2-470b-ad2f-aabe4be889c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:18.192308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44475a0c-abe2-470b-ad2f-aabe4be889c2 None admin] PATH_INFO: `/v3/projects/3804ce4a9bb248c68bcb5539322d5c8e` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:18.193433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44475a0c-abe2-470b-ad2f-aabe4be889c2 None admin] RBAC: Authorizing `identity:get_project(project_id=3804ce4a9bb248c68bcb5539322d5c8e)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:18.194847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44475a0c-abe2-470b-ad2f-aabe4be889c2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:18.196468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 580/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:18 2022] GET /identity/v3/projects/3804ce4a9bb248c68bcb5539322d5c8e => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:18.202570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d9318-2b90-439a-b228-964b8a02a348 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:18.299123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342d9318-2b90-439a-b228-964b8a02a348 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:18.320831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:18.331887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ffa6f-fae3-47cd-bc60-1d2a4f46f491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:18.332480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ffa6f-fae3-47cd-bc60-1d2a4f46f491 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:18.332754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ffa6f-fae3-47cd-bc60-1d2a4f46f491 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:18.333024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ffa6f-fae3-47cd-bc60-1d2a4f46f491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:18.333766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ffa6f-fae3-47cd-bc60-1d2a4f46f491 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=3804ce4a9bb248c68bcb5539322d5c8e, user.id=2da1c4551475424c9805c058d7be1e60) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:18.334068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ffa6f-fae3-47cd-bc60-1d2a4f46f491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:18.335484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ffa6f-fae3-47cd-bc60-1d2a4f46f491 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:18.341429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 566/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:18 2022] GET /identity/v3/role_assignments?user.id=2da1c4551475424c9805c058d7be1e60&scope.project.id=3804ce4a9bb248c68bcb5539322d5c8e&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:20.431128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c16c8b-ee7e-4a49-8e71-cf90d1cf3228 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:20.431536 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c16c8b-ee7e-4a49-8e71-cf90d1cf3228 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:20.431671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c16c8b-ee7e-4a49-8e71-cf90d1cf3228 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:20.433024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 581/1147] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:20.438630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38a2a0-0856-45c5-a209-a29910bf236e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:20.439055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38a2a0-0856-45c5-a209-a29910bf236e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:20.439174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38a2a0-0856-45c5-a209-a29910bf236e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:20.457587 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0f38a2a0-0856-45c5-a209-a29910bf236e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:20.458757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0f38a2a0-0856-45c5-a209-a29910bf236e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:20.522885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 567/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:20.786453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c16c8b-ee7e-4a49-8e71-cf90d1cf3228 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:20.789299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:20.884047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c16c8b-ee7e-4a49-8e71-cf90d1cf3228 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:20.915833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7322fe-6148-41dc-a457-09bf11ebc30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:20.916438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7322fe-6148-41dc-a457-09bf11ebc30b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:20.916715 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7322fe-6148-41dc-a457-09bf11ebc30b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:20.916982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7322fe-6148-41dc-a457-09bf11ebc30b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:20.927105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7322fe-6148-41dc-a457-09bf11ebc30b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-8a7322fe-6148-41dc-a457-09bf11ebc30b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:20.931778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:20.932866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:37:20.933764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 582/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:20.938698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38a2a0-0856-45c5-a209-a29910bf236e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:21.032868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38a2a0-0856-45c5-a209-a29910bf236e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:21.049918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:21.066419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55951c0b-c479-4a0e-a70a-b45ba7565e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:21.067000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55951c0b-c479-4a0e-a70a-b45ba7565e92 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:21.067277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55951c0b-c479-4a0e-a70a-b45ba7565e92 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:21.067543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55951c0b-c479-4a0e-a70a-b45ba7565e92 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:21.068195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55951c0b-c479-4a0e-a70a-b45ba7565e92 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:21.068493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55951c0b-c479-4a0e-a70a-b45ba7565e92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:21.069886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55951c0b-c479-4a0e-a70a-b45ba7565e92 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:21.077565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 568/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:21.083193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7322fe-6148-41dc-a457-09bf11ebc30b None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:21.142568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:21.180434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7322fe-6148-41dc-a457-09bf11ebc30b None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:21.211954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66223402-1d89-42b4-b120-efd82ff094b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:21.212562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66223402-1d89-42b4-b120-efd82ff094b9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:21.212838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66223402-1d89-42b4-b120-efd82ff094b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:21.213108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66223402-1d89-42b4-b120-efd82ff094b9 None admin] PATH_INFO: `/v3/users/2da1c4551475424c9805c058d7be1e60` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:21.215024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66223402-1d89-42b4-b120-efd82ff094b9 None admin] RBAC: Authorizing `identity:get_user(user_id=2da1c4551475424c9805c058d7be1e60)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:21.216426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66223402-1d89-42b4-b120-efd82ff094b9 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:21.218019 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 583/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:21 2022] GET /identity/v3/users/2da1c4551475424c9805c058d7be1e60 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:21.223530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55951c0b-c479-4a0e-a70a-b45ba7565e92 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:21.323554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55951c0b-c479-4a0e-a70a-b45ba7565e92 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:21.356415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74860e6f-7a01-4525-9fdf-45ed3bcb177a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:21.357031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860e6f-7a01-4525-9fdf-45ed3bcb177a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:21.357308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860e6f-7a01-4525-9fdf-45ed3bcb177a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:21.357611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74860e6f-7a01-4525-9fdf-45ed3bcb177a None admin] PATH_INFO: `/v3/projects/3804ce4a9bb248c68bcb5539322d5c8e` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:21.358695 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74860e6f-7a01-4525-9fdf-45ed3bcb177a None admin] RBAC: Authorizing `identity:get_project(project_id=3804ce4a9bb248c68bcb5539322d5c8e)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:21.360146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74860e6f-7a01-4525-9fdf-45ed3bcb177a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:21.361795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 569/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:21 2022] GET /identity/v3/projects/3804ce4a9bb248c68bcb5539322d5c8e => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:21.367775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66223402-1d89-42b4-b120-efd82ff094b9 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:21.466358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66223402-1d89-42b4-b120-efd82ff094b9 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:21.493151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:21.499216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b4113-eaac-43c1-bb25-98779d2f41a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:21.499870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b4113-eaac-43c1-bb25-98779d2f41a5 None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:21.500149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b4113-eaac-43c1-bb25-98779d2f41a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:21.500421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b4113-eaac-43c1-bb25-98779d2f41a5 None admin] PATH_INFO: `/v3/projects/3804ce4a9bb248c68bcb5539322d5c8e/users/2da1c4551475424c9805c058d7be1e60/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:21.502365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b4113-eaac-43c1-bb25-98779d2f41a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=3804ce4a9bb248c68bcb5539322d5c8e, user_id=2da1c4551475424c9805c058d7be1e60, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:21.503795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b4113-eaac-43c1-bb25-98779d2f41a5 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:21.516770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 584/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:37:21 2022] PUT /identity/v3/projects/3804ce4a9bb248c68bcb5539322d5c8e/users/2da1c4551475424c9805c058d7be1e60/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:37:23.623103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fceca-f770-4350-998e-266d50213248 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:23.623633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fceca-f770-4350-998e-266d50213248 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:23.623633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70fceca-f770-4350-998e-266d50213248 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:23.624968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 570/1154] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:23.630109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982daff-2eaa-4600-bc53-fd7cfe435aab None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:23.630522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982daff-2eaa-4600-bc53-fd7cfe435aab None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:23.630657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982daff-2eaa-4600-bc53-fd7cfe435aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:23.648867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0982daff-2eaa-4600-bc53-fd7cfe435aab None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:23.650073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0982daff-2eaa-4600-bc53-fd7cfe435aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:23.715882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 585/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:23.984433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fceca-f770-4350-998e-266d50213248 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:24.033139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:24.084109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70fceca-f770-4350-998e-266d50213248 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:24.115783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786178c6-ecd0-4a67-a146-9d6da982961c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:24.116411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786178c6-ecd0-4a67-a146-9d6da982961c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:24.116660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786178c6-ecd0-4a67-a146-9d6da982961c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:24.116929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786178c6-ecd0-4a67-a146-9d6da982961c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:24.127546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786178c6-ecd0-4a67-a146-9d6da982961c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-786178c6-ecd0-4a67-a146-9d6da982961c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:24.132287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:24.133552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:37:24.134833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 571/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:24.140346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982daff-2eaa-4600-bc53-fd7cfe435aab None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:24.252314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982daff-2eaa-4600-bc53-fd7cfe435aab None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:24.271620 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:24.286273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0833437-f744-47a2-920f-5461dc65649d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:24.286869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0833437-f744-47a2-920f-5461dc65649d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:24.287145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0833437-f744-47a2-920f-5461dc65649d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:24.287416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0833437-f744-47a2-920f-5461dc65649d None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:24.288069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0833437-f744-47a2-920f-5461dc65649d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:24.288368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0833437-f744-47a2-920f-5461dc65649d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:24.289759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0833437-f744-47a2-920f-5461dc65649d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:24.298021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 586/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:24.304070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786178c6-ecd0-4a67-a146-9d6da982961c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:24.400952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786178c6-ecd0-4a67-a146-9d6da982961c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:24.409248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:24.435366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e586f00-75ff-4e15-8652-9768677428ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:24.435993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586f00-75ff-4e15-8652-9768677428ab None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:24.436272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586f00-75ff-4e15-8652-9768677428ab None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:24.436543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e586f00-75ff-4e15-8652-9768677428ab None admin] PATH_INFO: `/v3/users/2da1c4551475424c9805c058d7be1e60` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:24.437679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e586f00-75ff-4e15-8652-9768677428ab None admin] RBAC: Authorizing `identity:get_user(user_id=2da1c4551475424c9805c058d7be1e60)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:24.439104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e586f00-75ff-4e15-8652-9768677428ab None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:24.440674 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 572/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:24 2022] GET /identity/v3/users/2da1c4551475424c9805c058d7be1e60 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:24.446617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0833437-f744-47a2-920f-5461dc65649d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:24.544989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0833437-f744-47a2-920f-5461dc65649d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:24.577488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e231bc0-cc93-44b4-a140-5303fd136de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:24.578083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e231bc0-cc93-44b4-a140-5303fd136de6 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:24.578362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e231bc0-cc93-44b4-a140-5303fd136de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:24.578637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e231bc0-cc93-44b4-a140-5303fd136de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:24.625469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:24.643847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e231bc0-cc93-44b4-a140-5303fd136de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:24.645278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e231bc0-cc93-44b4-a140-5303fd136de6 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:24.738739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 587/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:24.744684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e586f00-75ff-4e15-8652-9768677428ab None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:24.840474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e586f00-75ff-4e15-8652-9768677428ab None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:24.872264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95134ca9-bb57-4921-86d7-fc2f1412936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:24.872871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95134ca9-bb57-4921-86d7-fc2f1412936b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:24.873146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95134ca9-bb57-4921-86d7-fc2f1412936b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:24.873438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95134ca9-bb57-4921-86d7-fc2f1412936b None admin] PATH_INFO: `/v3/projects/3804ce4a9bb248c68bcb5539322d5c8e` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:24.874531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95134ca9-bb57-4921-86d7-fc2f1412936b None admin] RBAC: Authorizing `identity:get_project(project_id=3804ce4a9bb248c68bcb5539322d5c8e)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:24.875951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95134ca9-bb57-4921-86d7-fc2f1412936b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:24.877536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 573/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:24 2022] GET /identity/v3/projects/3804ce4a9bb248c68bcb5539322d5c8e => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:24.883593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e231bc0-cc93-44b4-a140-5303fd136de6 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:24.959944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:24.977648 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e231bc0-cc93-44b4-a140-5303fd136de6 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:25.009682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4299e-da16-45b9-ad0a-0212eb0eb127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:25.010265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4299e-da16-45b9-ad0a-0212eb0eb127 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:25.010540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4299e-da16-45b9-ad0a-0212eb0eb127 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:25.010805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4299e-da16-45b9-ad0a-0212eb0eb127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:25.012110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4299e-da16-45b9-ad0a-0212eb0eb127 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=3804ce4a9bb248c68bcb5539322d5c8e, user.id=2da1c4551475424c9805c058d7be1e60) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:25.012411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4299e-da16-45b9-ad0a-0212eb0eb127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:25.013829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4299e-da16-45b9-ad0a-0212eb0eb127 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:25.019309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 588/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:24 2022] GET /identity/v3/role_assignments?user.id=2da1c4551475424c9805c058d7be1e60&scope.project.id=3804ce4a9bb248c68bcb5539322d5c8e&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:27.146826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090acb6-ee24-4861-b47e-4a3629424aef None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:27.147386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090acb6-ee24-4861-b47e-4a3629424aef None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:27.147386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7090acb6-ee24-4861-b47e-4a3629424aef None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:27.148687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 574/1162] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:27.154367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82eaa7-201a-4dcd-8564-0342ad355682 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:27.154809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82eaa7-201a-4dcd-8564-0342ad355682 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:27.154912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82eaa7-201a-4dcd-8564-0342ad355682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:27.173237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ef82eaa7-201a-4dcd-8564-0342ad355682 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:27.174451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ef82eaa7-201a-4dcd-8564-0342ad355682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:27.237865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 589/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:27.503833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090acb6-ee24-4861-b47e-4a3629424aef None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:27.549139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:27.602763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7090acb6-ee24-4861-b47e-4a3629424aef None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:27.634885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5034b-9953-4f04-8299-5175fd36b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:27.635479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5034b-9953-4f04-8299-5175fd36b1ed None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:27.635760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5034b-9953-4f04-8299-5175fd36b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:27.636062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5034b-9953-4f04-8299-5175fd36b1ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:27.701085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5034b-9953-4f04-8299-5175fd36b1ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:27.702508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5034b-9953-4f04-8299-5175fd36b1ed None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:27.743791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:27.796700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 575/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:27.802668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82eaa7-201a-4dcd-8564-0342ad355682 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:27.875642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:27.898018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82eaa7-201a-4dcd-8564-0342ad355682 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:27.929677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e77807-533a-4635-b470-b799e12e4c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:27.930292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77807-533a-4635-b470-b799e12e4c7b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:27.930570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77807-533a-4635-b470-b799e12e4c7b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:27.930840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e77807-533a-4635-b470-b799e12e4c7b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:27.937748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e77807-533a-4635-b470-b799e12e4c7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:27.939175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e77807-533a-4635-b470-b799e12e4c7b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-03e77807-533a-4635-b470-b799e12e4c7b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:27.950896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:27.952138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:37:27.953286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 590/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:37:27 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:27.957880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5034b-9953-4f04-8299-5175fd36b1ed None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:28.052958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5034b-9953-4f04-8299-5175fd36b1ed None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:28.085138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7a417e-7554-4701-aea6-e34d258649ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:28.085749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a417e-7554-4701-aea6-e34d258649ac None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:28.086027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a417e-7554-4701-aea6-e34d258649ac None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:28.086299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7a417e-7554-4701-aea6-e34d258649ac None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:28.086922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a417e-7554-4701-aea6-e34d258649ac None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:28.087221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a417e-7554-4701-aea6-e34d258649ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:28.088823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7a417e-7554-4701-aea6-e34d258649ac None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:28.095571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 576/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 17 00:37:27 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:30.199979 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf81f-1a12-4dde-95aa-e64d9bfeb78e None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:30.200541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf81f-1a12-4dde-95aa-e64d9bfeb78e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:30.200541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fcf81f-1a12-4dde-95aa-e64d9bfeb78e None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:30.201907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 591/1167] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:30.207300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585111e-f9ab-401b-a420-746fba388bfe None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:30.207669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585111e-f9ab-401b-a420-746fba388bfe None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:30.207846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5585111e-f9ab-401b-a420-746fba388bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:30.225657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-5585111e-f9ab-401b-a420-746fba388bfe None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:30.226810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5585111e-f9ab-401b-a420-746fba388bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:30.228694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:30.293058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 577/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:30.560024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf81f-1a12-4dde-95aa-e64d9bfeb78e None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:30.656864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fcf81f-1a12-4dde-95aa-e64d9bfeb78e None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:30.688685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbb332-9719-4a0a-91a5-6c3fb2bbcebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:30.689267 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbb332-9719-4a0a-91a5-6c3fb2bbcebf None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:30.689573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbb332-9719-4a0a-91a5-6c3fb2bbcebf None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:30.689847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbb332-9719-4a0a-91a5-6c3fb2bbcebf None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:30.690508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbb332-9719-4a0a-91a5-6c3fb2bbcebf None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:30.691850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbb332-9719-4a0a-91a5-6c3fb2bbcebf None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:30.696435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:30.708623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 592/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Sat Sep 17 00:37:30 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:32.875038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb209-8b90-46d0-9357-c22e914aeee6 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:32.875594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb209-8b90-46d0-9357-c22e914aeee6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:32.875594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bbb209-8b90-46d0-9357-c22e914aeee6 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:32.876943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 578/1170] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:32.882347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886d3fa-148d-4dac-802d-eef520268e34 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:32.882724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886d3fa-148d-4dac-802d-eef520268e34 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:32.882889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2886d3fa-148d-4dac-802d-eef520268e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:32.900403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2886d3fa-148d-4dac-802d-eef520268e34 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:32.902100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2886d3fa-148d-4dac-802d-eef520268e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:32.965902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 593/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:33.233029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbb209-8b90-46d0-9357-c22e914aeee6 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:33.331846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bbb209-8b90-46d0-9357-c22e914aeee6 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:33.364556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb96e21d-7a3e-4bcc-9971-aea937d5dbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:33.365171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96e21d-7a3e-4bcc-9971-aea937d5dbb1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:33.365486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96e21d-7a3e-4bcc-9971-aea937d5dbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:33.365765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb96e21d-7a3e-4bcc-9971-aea937d5dbb1 None admin] PATH_INFO: `/v3/domains/623f578df3f64782ab189a2f2f942342` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:33.372636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:33.377307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96e21d-7a3e-4bcc-9971-aea937d5dbb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=623f578df3f64782ab189a2f2f942342)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:33.378782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb96e21d-7a3e-4bcc-9971-aea937d5dbb1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:33.380341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 579/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Sep 17 00:37:33 2022] GET /identity/v3/domains/623f578df3f64782ab189a2f2f942342 => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:33.386190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886d3fa-148d-4dac-802d-eef520268e34 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:33.480881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2886d3fa-148d-4dac-802d-eef520268e34 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:33.505619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:33.514435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c6b424-8eae-42de-95c2-73779d6128b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:33.515040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b424-8eae-42de-95c2-73779d6128b0 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:33.515316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b424-8eae-42de-95c2-73779d6128b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:33.515586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c6b424-8eae-42de-95c2-73779d6128b0 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:33.516243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6b424-8eae-42de-95c2-73779d6128b0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:33.517696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c6b424-8eae-42de-95c2-73779d6128b0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:33.542763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 594/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:37:33 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:37:35.667608 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8e12f-fcd2-42fd-9a3a-dd3a7c6ee36b None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:35.668107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8e12f-fcd2-42fd-9a3a-dd3a7c6ee36b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:35.668107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a8e12f-fcd2-42fd-9a3a-dd3a7c6ee36b None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:35.669460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 580/1174] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:35.674514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d47d28-68bb-4c79-bf88-7b6beb1cd4d6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:35.674971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d47d28-68bb-4c79-bf88-7b6beb1cd4d6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:35.675067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d47d28-68bb-4c79-bf88-7b6beb1cd4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:35.693486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f6d47d28-68bb-4c79-bf88-7b6beb1cd4d6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:35.694654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f6d47d28-68bb-4c79-bf88-7b6beb1cd4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:35.761569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 595/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:36.038241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8e12f-fcd2-42fd-9a3a-dd3a7c6ee36b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:36.143706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a8e12f-fcd2-42fd-9a3a-dd3a7c6ee36b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:36.176617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa640e-35df-43cd-8167-030bf61f2bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:36.177247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa640e-35df-43cd-8167-030bf61f2bb3 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:36.177557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa640e-35df-43cd-8167-030bf61f2bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:36.177832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa640e-35df-43cd-8167-030bf61f2bb3 None admin] PATH_INFO: `/v3/domains/623f578df3f64782ab189a2f2f942342` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:36.178940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa640e-35df-43cd-8167-030bf61f2bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=623f578df3f64782ab189a2f2f942342)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:36.180377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa640e-35df-43cd-8167-030bf61f2bb3 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:36.181971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 581/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Sep 17 00:37:36 2022] GET /identity/v3/domains/623f578df3f64782ab189a2f2f942342 => generated 267 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:36.187917 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d47d28-68bb-4c79-bf88-7b6beb1cd4d6 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:36.284590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d47d28-68bb-4c79-bf88-7b6beb1cd4d6 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:36.293985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:36.319495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ed7eb-3143-43a9-b648-b4d0ce422f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:36.320095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ed7eb-3143-43a9-b648-b4d0ce422f2d None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:36.320372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ed7eb-3143-43a9-b648-b4d0ce422f2d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:36.320648 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ed7eb-3143-43a9-b648-b4d0ce422f2d None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:36.321304 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ed7eb-3143-43a9-b648-b4d0ce422f2d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:36.322760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ed7eb-3143-43a9-b648-b4d0ce422f2d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:36.343571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 596/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:37:36 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:37:38.522603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43b4c-947e-4744-b8aa-6d425b9ac803 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:38.523138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43b4c-947e-4744-b8aa-6d425b9ac803 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:38.523138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a43b4c-947e-4744-b8aa-6d425b9ac803 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:38.524489 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 582/1178] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:38.530382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1d1f-c094-4181-b35e-2dbdbfbd866e None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:38.530799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1d1f-c094-4181-b35e-2dbdbfbd866e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:38.530921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164d1d1f-c094-4181-b35e-2dbdbfbd866e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:38.548507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-164d1d1f-c094-4181-b35e-2dbdbfbd866e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:38.549702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-164d1d1f-c094-4181-b35e-2dbdbfbd866e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:38.616119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 597/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:38.886063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a43b4c-947e-4744-b8aa-6d425b9ac803 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:38.952422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:38.988411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a43b4c-947e-4744-b8aa-6d425b9ac803 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:39.022009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eb9c1-3fe2-4734-9496-2865d3d25435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:39.022638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb9c1-3fe2-4734-9496-2865d3d25435 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:39.022915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb9c1-3fe2-4734-9496-2865d3d25435 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:39.023185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344eb9c1-3fe2-4734-9496-2865d3d25435 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:39.034082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344eb9c1-3fe2-4734-9496-2865d3d25435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-344eb9c1-3fe2-4734-9496-2865d3d25435 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:39.038788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:39.039880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:37:39.041072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 583/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:39.046570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d1d1f-c094-4181-b35e-2dbdbfbd866e None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:39.133651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:39.141084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164d1d1f-c094-4181-b35e-2dbdbfbd866e None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:39.173488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaea92-bdcc-4b90-9dcc-36dd5612b60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:39.174081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaea92-bdcc-4b90-9dcc-36dd5612b60c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:39.174355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaea92-bdcc-4b90-9dcc-36dd5612b60c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:39.174622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eaea92-bdcc-4b90-9dcc-36dd5612b60c None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:39.175279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaea92-bdcc-4b90-9dcc-36dd5612b60c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:39.175577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaea92-bdcc-4b90-9dcc-36dd5612b60c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:39.176921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eaea92-bdcc-4b90-9dcc-36dd5612b60c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:39.184503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 598/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:39.190343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eb9c1-3fe2-4734-9496-2865d3d25435 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:39.294754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344eb9c1-3fe2-4734-9496-2865d3d25435 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:39.318526 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:39.327703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01864ea-eb94-4034-b37a-621d498c57ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:39.328323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01864ea-eb94-4034-b37a-621d498c57ec None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:39.328598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01864ea-eb94-4034-b37a-621d498c57ec None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:39.328870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01864ea-eb94-4034-b37a-621d498c57ec None admin] PATH_INFO: `/v3/users/958e6b4afe8b4063b14778d1e9956648` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:39.342158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01864ea-eb94-4034-b37a-621d498c57ec None admin] RBAC: Authorizing `identity:get_user(user_id=958e6b4afe8b4063b14778d1e9956648)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:39.343583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01864ea-eb94-4034-b37a-621d498c57ec None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:39.345153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 584/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:39 2022] GET /identity/v3/users/958e6b4afe8b4063b14778d1e9956648 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:39.351078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaea92-bdcc-4b90-9dcc-36dd5612b60c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:39.447431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eaea92-bdcc-4b90-9dcc-36dd5612b60c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:39.480138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83f1f4-5256-48a6-b34a-c2e1f891102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:39.480736 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83f1f4-5256-48a6-b34a-c2e1f891102d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:39.481014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83f1f4-5256-48a6-b34a-c2e1f891102d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:39.481287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb83f1f4-5256-48a6-b34a-c2e1f891102d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:39.515750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:39.564525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83f1f4-5256-48a6-b34a-c2e1f891102d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:39.565990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb83f1f4-5256-48a6-b34a-c2e1f891102d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:39.660165 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 599/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:39.666094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01864ea-eb94-4034-b37a-621d498c57ec None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:39.760247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01864ea-eb94-4034-b37a-621d498c57ec None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:39.793107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117266b6-7c8e-4a98-b6d2-dd9bd7ef48bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:39.793736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117266b6-7c8e-4a98-b6d2-dd9bd7ef48bc None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:39.794012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117266b6-7c8e-4a98-b6d2-dd9bd7ef48bc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:39.794280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117266b6-7c8e-4a98-b6d2-dd9bd7ef48bc None admin] PATH_INFO: `/v3/projects/35d35a2a8267471bb70694394447429a` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:39.795370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117266b6-7c8e-4a98-b6d2-dd9bd7ef48bc None admin] RBAC: Authorizing `identity:get_project(project_id=35d35a2a8267471bb70694394447429a)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:39.796783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117266b6-7c8e-4a98-b6d2-dd9bd7ef48bc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:39.798376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 585/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:39 2022] GET /identity/v3/projects/35d35a2a8267471bb70694394447429a => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:39.804386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83f1f4-5256-48a6-b34a-c2e1f891102d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:39.870188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:39.911440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb83f1f4-5256-48a6-b34a-c2e1f891102d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:39.943552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5991d245-f521-43e4-9546-20221b3f7894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:39.944143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991d245-f521-43e4-9546-20221b3f7894 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:39.944420 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991d245-f521-43e4-9546-20221b3f7894 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:39.944690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5991d245-f521-43e4-9546-20221b3f7894 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:39.945427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991d245-f521-43e4-9546-20221b3f7894 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=35d35a2a8267471bb70694394447429a, user.id=958e6b4afe8b4063b14778d1e9956648) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:39.945735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991d245-f521-43e4-9546-20221b3f7894 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:39.947146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5991d245-f521-43e4-9546-20221b3f7894 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:39.952278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 600/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:39 2022] GET /identity/v3/role_assignments?user.id=958e6b4afe8b4063b14778d1e9956648&scope.project.id=35d35a2a8267471bb70694394447429a&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:42.053060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa8c12-7ec9-4590-bf1b-5b9cb1f1cb80 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:42.053645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa8c12-7ec9-4590-bf1b-5b9cb1f1cb80 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:42.053645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fa8c12-7ec9-4590-bf1b-5b9cb1f1cb80 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:42.054940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 586/1186] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:42.060170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342109f3-b2c3-47ca-ad9c-45c185f7d2da None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:42.060600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342109f3-b2c3-47ca-ad9c-45c185f7d2da None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:42.060717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342109f3-b2c3-47ca-ad9c-45c185f7d2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:42.078453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-342109f3-b2c3-47ca-ad9c-45c185f7d2da None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:42.079625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-342109f3-b2c3-47ca-ad9c-45c185f7d2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:42.144784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 601/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:42.411909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa8c12-7ec9-4590-bf1b-5b9cb1f1cb80 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:42.464620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:42.511257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fa8c12-7ec9-4590-bf1b-5b9cb1f1cb80 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:42.543486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405e81f-7f5c-45dc-b43a-33645daf9927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:42.544106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405e81f-7f5c-45dc-b43a-33645daf9927 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:42.544384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405e81f-7f5c-45dc-b43a-33645daf9927 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:42.544655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c405e81f-7f5c-45dc-b43a-33645daf9927 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:42.554325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c405e81f-7f5c-45dc-b43a-33645daf9927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-c405e81f-7f5c-45dc-b43a-33645daf9927 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:42.559647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:42.560773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:37:42.561647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 587/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:42.566722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342109f3-b2c3-47ca-ad9c-45c185f7d2da None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:42.614352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:42.663296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342109f3-b2c3-47ca-ad9c-45c185f7d2da None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:42.695727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afd091-4bcd-41f9-8c84-b1c267cb3ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:42.696327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd091-4bcd-41f9-8c84-b1c267cb3ef6 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:42.696609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd091-4bcd-41f9-8c84-b1c267cb3ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:42.696881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49afd091-4bcd-41f9-8c84-b1c267cb3ef6 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:42.697570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afd091-4bcd-41f9-8c84-b1c267cb3ef6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:42.697903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afd091-4bcd-41f9-8c84-b1c267cb3ef6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:42.699261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49afd091-4bcd-41f9-8c84-b1c267cb3ef6 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:42.706942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 602/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:42.712728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405e81f-7f5c-45dc-b43a-33645daf9927 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:42.810159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c405e81f-7f5c-45dc-b43a-33645daf9927 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:42.822588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:42.844098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58b68-6ea0-4849-8a6d-36978732813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:42.844709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58b68-6ea0-4849-8a6d-36978732813d None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:42.844992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58b68-6ea0-4849-8a6d-36978732813d None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:42.845267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc58b68-6ea0-4849-8a6d-36978732813d None admin] PATH_INFO: `/v3/users/958e6b4afe8b4063b14778d1e9956648` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:42.846408 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc58b68-6ea0-4849-8a6d-36978732813d None admin] RBAC: Authorizing `identity:get_user(user_id=958e6b4afe8b4063b14778d1e9956648)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:42.847837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc58b68-6ea0-4849-8a6d-36978732813d None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:42.849378 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 588/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:42 2022] GET /identity/v3/users/958e6b4afe8b4063b14778d1e9956648 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:42.855574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afd091-4bcd-41f9-8c84-b1c267cb3ef6 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:42.950017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49afd091-4bcd-41f9-8c84-b1c267cb3ef6 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:42.961937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:42.983246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fda6f-3b41-4031-aa1d-aaf8a06cc690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:42.983858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fda6f-3b41-4031-aa1d-aaf8a06cc690 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:42.984141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fda6f-3b41-4031-aa1d-aaf8a06cc690 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:42.984417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fda6f-3b41-4031-aa1d-aaf8a06cc690 None admin] PATH_INFO: `/v3/projects/35d35a2a8267471bb70694394447429a` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:42.985550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fda6f-3b41-4031-aa1d-aaf8a06cc690 None admin] RBAC: Authorizing `identity:get_project(project_id=35d35a2a8267471bb70694394447429a)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:42.986964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fda6f-3b41-4031-aa1d-aaf8a06cc690 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:42.988562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 603/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:42 2022] GET /identity/v3/projects/35d35a2a8267471bb70694394447429a => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:42.994329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58b68-6ea0-4849-8a6d-36978732813d None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:43.089634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc58b68-6ea0-4849-8a6d-36978732813d None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:43.121325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33993d6-2d9c-4c2d-8579-b1dec70d0f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:43.121984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33993d6-2d9c-4c2d-8579-b1dec70d0f3f None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:43.122259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33993d6-2d9c-4c2d-8579-b1dec70d0f3f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:43.122528 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33993d6-2d9c-4c2d-8579-b1dec70d0f3f None admin] PATH_INFO: `/v3/projects/35d35a2a8267471bb70694394447429a/users/958e6b4afe8b4063b14778d1e9956648/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:43.124373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33993d6-2d9c-4c2d-8579-b1dec70d0f3f None admin] RBAC: Authorizing `identity:create_grant(project_id=35d35a2a8267471bb70694394447429a, user_id=958e6b4afe8b4063b14778d1e9956648, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:43.125828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33993d6-2d9c-4c2d-8579-b1dec70d0f3f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:43.138968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 589/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:37:42 2022] PUT /identity/v3/projects/35d35a2a8267471bb70694394447429a/users/958e6b4afe8b4063b14778d1e9956648/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:37:45.232754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f381b-1e91-4fee-9620-35758ecd21e7 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:45.233287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f381b-1e91-4fee-9620-35758ecd21e7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:45.233287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7f381b-1e91-4fee-9620-35758ecd21e7 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:45.234663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 604/1193] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:37:45.239807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0f948-fa46-4e6d-a16a-0d9091567d08 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:45.240232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0f948-fa46-4e6d-a16a-0d9091567d08 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:45.240353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0f948-fa46-4e6d-a16a-0d9091567d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:45.258437 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-13d0f948-fa46-4e6d-a16a-0d9091567d08 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:37:45.259594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-13d0f948-fa46-4e6d-a16a-0d9091567d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:37:45.292765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:45.325021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 590/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:37:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:37:45.590010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f381b-1e91-4fee-9620-35758ecd21e7 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:45.690821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7f381b-1e91-4fee-9620-35758ecd21e7 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:45.722489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa722a9-8c78-451a-8003-234b1f32851c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:45.723100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa722a9-8c78-451a-8003-234b1f32851c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:45.723376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa722a9-8c78-451a-8003-234b1f32851c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:45.723645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa722a9-8c78-451a-8003-234b1f32851c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:45.734241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa722a9-8c78-451a-8003-234b1f32851c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-4fa722a9-8c78-451a-8003-234b1f32851c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:37:45.738915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:37:45.739897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:37:45.740759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 605/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:37:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:37:45.746021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0f948-fa46-4e6d-a16a-0d9091567d08 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:45.840868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0f948-fa46-4e6d-a16a-0d9091567d08 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:45.873722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154c3b-e6c1-4225-878a-9f9618936698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:45.874316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154c3b-e6c1-4225-878a-9f9618936698 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:45.874593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154c3b-e6c1-4225-878a-9f9618936698 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:45.874867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12154c3b-e6c1-4225-878a-9f9618936698 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:45.875524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12154c3b-e6c1-4225-878a-9f9618936698 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:45.875823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12154c3b-e6c1-4225-878a-9f9618936698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:45.877191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12154c3b-e6c1-4225-878a-9f9618936698 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:45.884856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 591/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:37:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:45.890992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa722a9-8c78-451a-8003-234b1f32851c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:45.930181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:45.986008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa722a9-8c78-451a-8003-234b1f32851c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:46.018898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeca27-4ed9-4c24-a25e-ec84ab397b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:46.019510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeca27-4ed9-4c24-a25e-ec84ab397b6c None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:46.019789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeca27-4ed9-4c24-a25e-ec84ab397b6c None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:46.020063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aeca27-4ed9-4c24-a25e-ec84ab397b6c None admin] PATH_INFO: `/v3/users/958e6b4afe8b4063b14778d1e9956648` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:46.021163 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aeca27-4ed9-4c24-a25e-ec84ab397b6c None admin] RBAC: Authorizing `identity:get_user(user_id=958e6b4afe8b4063b14778d1e9956648)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:46.022646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aeca27-4ed9-4c24-a25e-ec84ab397b6c None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:46.024196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 606/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 17 00:37:45 2022] GET /identity/v3/users/958e6b4afe8b4063b14778d1e9956648 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:46.029844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154c3b-e6c1-4225-878a-9f9618936698 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:46.061878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:46.128049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12154c3b-e6c1-4225-878a-9f9618936698 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:46.161274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f270768-c577-4305-ab43-f3fce9eb8169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:46.161899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f270768-c577-4305-ab43-f3fce9eb8169 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:46.162177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f270768-c577-4305-ab43-f3fce9eb8169 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:46.162451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f270768-c577-4305-ab43-f3fce9eb8169 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:46.226944 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f270768-c577-4305-ab43-f3fce9eb8169 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:46.228382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f270768-c577-4305-ab43-f3fce9eb8169 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:46.256602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:46.323019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 592/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:37:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:37:46.328948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeca27-4ed9-4c24-a25e-ec84ab397b6c None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:46.425991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aeca27-4ed9-4c24-a25e-ec84ab397b6c None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:46.434587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:46.458708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4159f4c5-0e1f-45e2-8152-dc7bf1107a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:46.459322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159f4c5-0e1f-45e2-8152-dc7bf1107a2b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:46.459598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159f4c5-0e1f-45e2-8152-dc7bf1107a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:46.459869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4159f4c5-0e1f-45e2-8152-dc7bf1107a2b None admin] PATH_INFO: `/v3/projects/35d35a2a8267471bb70694394447429a` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:46.460959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159f4c5-0e1f-45e2-8152-dc7bf1107a2b None admin] RBAC: Authorizing `identity:get_project(project_id=35d35a2a8267471bb70694394447429a)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:46.462393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4159f4c5-0e1f-45e2-8152-dc7bf1107a2b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:46.464496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 607/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 17 00:37:46 2022] GET /identity/v3/projects/35d35a2a8267471bb70694394447429a => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:46.470559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f270768-c577-4305-ab43-f3fce9eb8169 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:37:46.564465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f270768-c577-4305-ab43-f3fce9eb8169 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:37:46.592205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:46.597331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd203e56-a86d-452f-978c-f9f0cd402b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:37:46.597946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203e56-a86d-452f-978c-f9f0cd402b37 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:37:46.598222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203e56-a86d-452f-978c-f9f0cd402b37 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:37:46.598496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd203e56-a86d-452f-978c-f9f0cd402b37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:37:46.599208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd203e56-a86d-452f-978c-f9f0cd402b37 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=35d35a2a8267471bb70694394447429a, user.id=958e6b4afe8b4063b14778d1e9956648) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:37:46.599508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd203e56-a86d-452f-978c-f9f0cd402b37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:37:46.600922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd203e56-a86d-452f-978c-f9f0cd402b37 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:37:46.607059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 593/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:37:46 2022] GET /identity/v3/role_assignments?user.id=958e6b4afe8b4063b14778d1e9956648&scope.project.id=35d35a2a8267471bb70694394447429a&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:37:56.454672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=12 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:37:56.603942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:42.077070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575ad8-bdb9-422e-a9ae-5872cdd1d770 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:42.077711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575ad8-bdb9-422e-a9ae-5872cdd1d770 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:42.077835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6575ad8-bdb9-422e-a9ae-5872cdd1d770 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:42.079430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 608/1201] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:38:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:38:42.087350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ec897-316e-42af-9e68-7199b3c96782 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:42.087893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ec897-316e-42af-9e68-7199b3c96782 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:42.088164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298ec897-316e-42af-9e68-7199b3c96782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:42.115575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-298ec897-316e-42af-9e68-7199b3c96782 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:38:42.116724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-298ec897-316e-42af-9e68-7199b3c96782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:38:42.213808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 594/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:38:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:38:42.503164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6575ad8-bdb9-422e-a9ae-5872cdd1d770 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:42.638440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6575ad8-bdb9-422e-a9ae-5872cdd1d770 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:42.685362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40159a07-df4c-4ec6-b688-e37743dd38b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:42.685362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40159a07-df4c-4ec6-b688-e37743dd38b0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:42.685362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40159a07-df4c-4ec6-b688-e37743dd38b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:42.685362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40159a07-df4c-4ec6-b688-e37743dd38b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:42.697562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40159a07-df4c-4ec6-b688-e37743dd38b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:42.699227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40159a07-df4c-4ec6-b688-e37743dd38b0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-40159a07-df4c-4ec6-b688-e37743dd38b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:42.715769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:42.716934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:42.718059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:42.718059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:42.718059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:38:42.718059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 609/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 17 00:38:42.726653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ec897-316e-42af-9e68-7199b3c96782 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:42.863556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298ec897-316e-42af-9e68-7199b3c96782 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:42.898105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:42.906641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d971f07c-bf4a-4dc1-8dc4-a0566635f65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:42.907375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971f07c-bf4a-4dc1-8dc4-a0566635f65f None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:42.907743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971f07c-bf4a-4dc1-8dc4-a0566635f65f None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:42.908061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d971f07c-bf4a-4dc1-8dc4-a0566635f65f None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:42.908797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971f07c-bf4a-4dc1-8dc4-a0566635f65f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:42.909096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971f07c-bf4a-4dc1-8dc4-a0566635f65f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:42.910589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d971f07c-bf4a-4dc1-8dc4-a0566635f65f None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:42.923446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 595/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:42.929762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40159a07-df4c-4ec6-b688-e37743dd38b0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:43.015014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:43.083097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40159a07-df4c-4ec6-b688-e37743dd38b0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:43.127633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7759a3be-44b6-465b-91c7-89738653dc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:43.128259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a3be-44b6-465b-91c7-89738653dc53 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:43.128545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a3be-44b6-465b-91c7-89738653dc53 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:43.128828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759a3be-44b6-465b-91c7-89738653dc53 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:43.129511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759a3be-44b6-465b-91c7-89738653dc53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:43.131548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7759a3be-44b6-465b-91c7-89738653dc53 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:43.157009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 610/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 17 00:38:42 2022] POST /identity/v3/users => generated 251 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:38:45.693487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8d011-1058-49c5-8927-b88472b3c3f4 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:45.694005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8d011-1058-49c5-8927-b88472b3c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:45.694005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a8d011-1058-49c5-8927-b88472b3c3f4 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:45.695641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 596/1206] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:38:45.701745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0e615-8f3c-4cf6-b0a6-14f9d3eace58 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:45.702220 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0e615-8f3c-4cf6-b0a6-14f9d3eace58 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:45.702324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a0e615-8f3c-4cf6-b0a6-14f9d3eace58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:45.721695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-82a0e615-8f3c-4cf6-b0a6-14f9d3eace58 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:38:45.722897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-82a0e615-8f3c-4cf6-b0a6-14f9d3eace58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:38:45.806447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 611/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:38:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:38:46.079089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8d011-1058-49c5-8927-b88472b3c3f4 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:46.204471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a8d011-1058-49c5-8927-b88472b3c3f4 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:46.256860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275252f9-82fd-4111-89c8-16fc8b84ceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:46.258552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275252f9-82fd-4111-89c8-16fc8b84ceb6 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:46.258989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275252f9-82fd-4111-89c8-16fc8b84ceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:46.259450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275252f9-82fd-4111-89c8-16fc8b84ceb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:46.274569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275252f9-82fd-4111-89c8-16fc8b84ceb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-275252f9-82fd-4111-89c8-16fc8b84ceb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:38:46.279537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:46.280533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:46.281483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:46.285575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 597/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:38:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:46.287665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0e615-8f3c-4cf6-b0a6-14f9d3eace58 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:46.345008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:46.418992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a0e615-8f3c-4cf6-b0a6-14f9d3eace58 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:46.466787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59c3e-4e0f-4802-a1ad-2424f10ecd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:46.467398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59c3e-4e0f-4802-a1ad-2424f10ecd36 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:46.467676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59c3e-4e0f-4802-a1ad-2424f10ecd36 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:46.467946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a59c3e-4e0f-4802-a1ad-2424f10ecd36 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:46.468624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59c3e-4e0f-4802-a1ad-2424f10ecd36 None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:46.468926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59c3e-4e0f-4802-a1ad-2424f10ecd36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:46.470330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a59c3e-4e0f-4802-a1ad-2424f10ecd36 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:46.480486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 612/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:38:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:46.486249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275252f9-82fd-4111-89c8-16fc8b84ceb6 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:46.555213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:46.608844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275252f9-82fd-4111-89c8-16fc8b84ceb6 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:46.653152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db7698-2b4d-4e85-98f6-b381f8c4d192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:46.653981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db7698-2b4d-4e85-98f6-b381f8c4d192 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:46.654280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db7698-2b4d-4e85-98f6-b381f8c4d192 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:46.654580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49db7698-2b4d-4e85-98f6-b381f8c4d192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:46.667698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db7698-2b4d-4e85-98f6-b381f8c4d192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:46.669882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49db7698-2b4d-4e85-98f6-b381f8c4d192 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-49db7698-2b4d-4e85-98f6-b381f8c4d192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:46.695340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:46.702308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:46.703406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:46.703406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:46.703406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:46.703406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 598/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:46.704171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59c3e-4e0f-4802-a1ad-2424f10ecd36 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:46.827555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:46.831773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a59c3e-4e0f-4802-a1ad-2424f10ecd36 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:46.870658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e83918-1c1b-4909-809a-930f7873a9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:46.871556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e83918-1c1b-4909-809a-930f7873a9a4 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:46.872035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e83918-1c1b-4909-809a-930f7873a9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:46.872479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e83918-1c1b-4909-809a-930f7873a9a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:46.873384 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e83918-1c1b-4909-809a-930f7873a9a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:46.873971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e83918-1c1b-4909-809a-930f7873a9a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:46.875787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e83918-1c1b-4909-809a-930f7873a9a4 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:46.890644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 613/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:46.896811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db7698-2b4d-4e85-98f6-b381f8c4d192 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:47.034075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49db7698-2b4d-4e85-98f6-b381f8c4d192 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:47.035639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:47.072474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286bfb8-f524-4a14-b064-0c2b59c5492b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:47.073102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286bfb8-f524-4a14-b064-0c2b59c5492b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:47.073385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286bfb8-f524-4a14-b064-0c2b59c5492b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:47.073715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f286bfb8-f524-4a14-b064-0c2b59c5492b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:47.081902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286bfb8-f524-4a14-b064-0c2b59c5492b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:47.083336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f286bfb8-f524-4a14-b064-0c2b59c5492b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-f286bfb8-f524-4a14-b064-0c2b59c5492b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:38:47.095574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:47.096738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:47.097822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 599/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:47.103124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e83918-1c1b-4909-809a-930f7873a9a4 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:47.228619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e83918-1c1b-4909-809a-930f7873a9a4 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:47.267844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ed17-12f8-4bf9-855b-298b6b8a91e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:47.268436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ed17-12f8-4bf9-855b-298b6b8a91e0 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:47.268708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ed17-12f8-4bf9-855b-298b6b8a91e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:47.268979 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8ed17-12f8-4bf9-855b-298b6b8a91e0 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:47.269762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ed17-12f8-4bf9-855b-298b6b8a91e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:47.270057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ed17-12f8-4bf9-855b-298b6b8a91e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:47.271472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8ed17-12f8-4bf9-855b-298b6b8a91e0 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:47.291579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 614/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 17 00:38:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:47.296959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286bfb8-f524-4a14-b064-0c2b59c5492b None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:47.431396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f286bfb8-f524-4a14-b064-0c2b59c5492b None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:47.471788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28de01-b17f-42a0-ab3c-93aaf926bea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:47.472440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28de01-b17f-42a0-ab3c-93aaf926bea6 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:47.472736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28de01-b17f-42a0-ab3c-93aaf926bea6 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:47.473032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef28de01-b17f-42a0-ab3c-93aaf926bea6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:47.515558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:47.565683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28de01-b17f-42a0-ab3c-93aaf926bea6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:47.567471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef28de01-b17f-42a0-ab3c-93aaf926bea6 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:47.686579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 600/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:38:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:38:47.693159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ed17-12f8-4bf9-855b-298b6b8a91e0 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:47.718268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:47.830047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8ed17-12f8-4bf9-855b-298b6b8a91e0 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:47.868322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19687191-d5a5-48b6-a894-c9817e2d1ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:47.868955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19687191-d5a5-48b6-a894-c9817e2d1ec9 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:47.869236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19687191-d5a5-48b6-a894-c9817e2d1ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:47.869540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19687191-d5a5-48b6-a894-c9817e2d1ec9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:47.880586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19687191-d5a5-48b6-a894-c9817e2d1ec9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:47.882131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19687191-d5a5-48b6-a894-c9817e2d1ec9 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-19687191-d5a5-48b6-a894-c9817e2d1ec9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:47.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:47.902822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:47.903860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:47.903860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:47.903860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:38:47.903860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 615/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:47.908953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28de01-b17f-42a0-ab3c-93aaf926bea6 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:47.982576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:48.030826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef28de01-b17f-42a0-ab3c-93aaf926bea6 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:48.070393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b37666-05b4-48b4-9d00-efda0e4b1863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:48.071601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b37666-05b4-48b4-9d00-efda0e4b1863 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:48.071876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b37666-05b4-48b4-9d00-efda0e4b1863 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:48.072147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b37666-05b4-48b4-9d00-efda0e4b1863 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:48.072788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b37666-05b4-48b4-9d00-efda0e4b1863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:48.073090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b37666-05b4-48b4-9d00-efda0e4b1863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:48.074499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b37666-05b4-48b4-9d00-efda0e4b1863 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:48.085616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 601/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:48.092195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19687191-d5a5-48b6-a894-c9817e2d1ec9 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:48.172875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:48.216028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19687191-d5a5-48b6-a894-c9817e2d1ec9 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:48.253675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb8eb8-ed34-437b-b9a6-426d83bda21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:48.254296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb8eb8-ed34-437b-b9a6-426d83bda21e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:48.254606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb8eb8-ed34-437b-b9a6-426d83bda21e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:48.254839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb8eb8-ed34-437b-b9a6-426d83bda21e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:48.262372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb8eb8-ed34-437b-b9a6-426d83bda21e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:48.263807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb8eb8-ed34-437b-b9a6-426d83bda21e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-e4fb8eb8-ed34-437b-b9a6-426d83bda21e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:38:48.275050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:48.276057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:48.276970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:38:48.276970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:38:48.276970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:38:48.276970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:38:48.276970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:38:48.276970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:38:48.276970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:48.276970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:38:48.276970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 616/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:38:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:48.282280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b37666-05b4-48b4-9d00-efda0e4b1863 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:48.392604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b37666-05b4-48b4-9d00-efda0e4b1863 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:48.417782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:48.431488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064019b0-3c24-48ca-94ed-643b0304961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:48.432093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064019b0-3c24-48ca-94ed-643b0304961a None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:48.432371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064019b0-3c24-48ca-94ed-643b0304961a None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:48.432640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064019b0-3c24-48ca-94ed-643b0304961a None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:48.433328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064019b0-3c24-48ca-94ed-643b0304961a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:48.433672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064019b0-3c24-48ca-94ed-643b0304961a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:48.435093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064019b0-3c24-48ca-94ed-643b0304961a None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:48.452966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 602/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:38:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:38:48.454178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb8eb8-ed34-437b-b9a6-426d83bda21e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:48.560606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb8eb8-ed34-437b-b9a6-426d83bda21e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:48.593710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:48.603242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466635be-91d1-41f1-a4bf-f716703f6f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:48.604282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466635be-91d1-41f1-a4bf-f716703f6f2e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:48.604862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466635be-91d1-41f1-a4bf-f716703f6f2e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:48.605351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466635be-91d1-41f1-a4bf-f716703f6f2e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:48.606312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466635be-91d1-41f1-a4bf-f716703f6f2e None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=47fef4612fbd4d00ad8de2a2144a2ba5) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:48.606730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466635be-91d1-41f1-a4bf-f716703f6f2e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:48.608857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466635be-91d1-41f1-a4bf-f716703f6f2e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:48.617877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 617/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:38:48 2022] GET /identity/v3/role_assignments?user.id=47fef4612fbd4d00ad8de2a2144a2ba5&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:38:50.775220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbb664-5d11-4a34-9a74-cd8d2688021e None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:50.775768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbb664-5d11-4a34-9a74-cd8d2688021e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:50.775858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bbb664-5d11-4a34-9a74-cd8d2688021e None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:50.777153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 603/1220] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:38:50.782728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2d82d-6282-4a75-b77d-cb1e50ba27b4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:50.783194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2d82d-6282-4a75-b77d-cb1e50ba27b4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:50.783294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2d82d-6282-4a75-b77d-cb1e50ba27b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:50.807198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-72f2d82d-6282-4a75-b77d-cb1e50ba27b4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:38:50.808649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-72f2d82d-6282-4a75-b77d-cb1e50ba27b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:38:50.894945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 618/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:38:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 17 00:38:51.163816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbb664-5d11-4a34-9a74-cd8d2688021e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:51.277956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bbb664-5d11-4a34-9a74-cd8d2688021e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:51.311843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac9a6a-5b8e-468e-a126-b5f0b29e322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:51.312548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac9a6a-5b8e-468e-a126-b5f0b29e322e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:51.312982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac9a6a-5b8e-468e-a126-b5f0b29e322e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:51.313375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac9a6a-5b8e-468e-a126-b5f0b29e322e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:51.326033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac9a6a-5b8e-468e-a126-b5f0b29e322e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-bcac9a6a-5b8e-468e-a126-b5f0b29e322e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:38:51.331789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:51.332867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:51.334049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 604/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:38:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:51.341305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2d82d-6282-4a75-b77d-cb1e50ba27b4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:51.450278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2d82d-6282-4a75-b77d-cb1e50ba27b4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:51.474950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:51.488048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8633c2-b02a-4c13-a32a-48026744afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:51.488729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8633c2-b02a-4c13-a32a-48026744afe3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:51.489078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8633c2-b02a-4c13-a32a-48026744afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:51.489391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8633c2-b02a-4c13-a32a-48026744afe3 None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:51.490194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8633c2-b02a-4c13-a32a-48026744afe3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:51.490529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8633c2-b02a-4c13-a32a-48026744afe3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:51.492775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8633c2-b02a-4c13-a32a-48026744afe3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:51.501876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 619/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:38:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:51.508632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac9a6a-5b8e-468e-a126-b5f0b29e322e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:51.559817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:51.622358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac9a6a-5b8e-468e-a126-b5f0b29e322e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:51.673002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081727-0e5e-4428-83bc-15092c04b123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:51.673599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081727-0e5e-4428-83bc-15092c04b123 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:51.673884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081727-0e5e-4428-83bc-15092c04b123 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:51.674162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f081727-0e5e-4428-83bc-15092c04b123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:51.685847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081727-0e5e-4428-83bc-15092c04b123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:51.687303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f081727-0e5e-4428-83bc-15092c04b123 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-9f081727-0e5e-4428-83bc-15092c04b123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:51.702738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:51.703913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:51.704960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:51.704960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:51.704960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:51.704960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 605/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:51.709894 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8633c2-b02a-4c13-a32a-48026744afe3 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:51.814925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8633c2-b02a-4c13-a32a-48026744afe3 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:51.852764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816c81c-af56-40c7-b8e3-8c51e7dba994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:51.853521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816c81c-af56-40c7-b8e3-8c51e7dba994 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:51.853818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816c81c-af56-40c7-b8e3-8c51e7dba994 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:51.854097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816c81c-af56-40c7-b8e3-8c51e7dba994 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:51.854738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816c81c-af56-40c7-b8e3-8c51e7dba994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:51.855041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816c81c-af56-40c7-b8e3-8c51e7dba994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:51.856416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816c81c-af56-40c7-b8e3-8c51e7dba994 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:51.869025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 620/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:38:51.875574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081727-0e5e-4428-83bc-15092c04b123 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:51.978624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:51.985353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f081727-0e5e-4428-83bc-15092c04b123 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:52.022444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7370d41-f248-446d-9ad2-22c71f17a134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:52.023605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7370d41-f248-446d-9ad2-22c71f17a134 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:52.023968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7370d41-f248-446d-9ad2-22c71f17a134 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:52.024237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7370d41-f248-446d-9ad2-22c71f17a134 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:52.032516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7370d41-f248-446d-9ad2-22c71f17a134 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:52.034338 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7370d41-f248-446d-9ad2-22c71f17a134 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-b7370d41-f248-446d-9ad2-22c71f17a134 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:38:52.048422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:52.049385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:52.050458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 606/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:52.057101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816c81c-af56-40c7-b8e3-8c51e7dba994 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:52.105133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:52.163945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816c81c-af56-40c7-b8e3-8c51e7dba994 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:52.203397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ed2d0-8c43-424c-b745-64bcb8522db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:52.204004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ed2d0-8c43-424c-b745-64bcb8522db3 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:52.204280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ed2d0-8c43-424c-b745-64bcb8522db3 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:52.204552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710ed2d0-8c43-424c-b745-64bcb8522db3 None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:52.205272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ed2d0-8c43-424c-b745-64bcb8522db3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:52.205621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ed2d0-8c43-424c-b745-64bcb8522db3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:52.207044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710ed2d0-8c43-424c-b745-64bcb8522db3 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:52.224768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 621/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 17 00:38:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:52.231431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7370d41-f248-446d-9ad2-22c71f17a134 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:52.351032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7370d41-f248-446d-9ad2-22c71f17a134 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:52.390747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efc96-6f02-4d4c-a465-1dd2ce911303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:52.391379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efc96-6f02-4d4c-a465-1dd2ce911303 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:52.391661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efc96-6f02-4d4c-a465-1dd2ce911303 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:52.391959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efc96-6f02-4d4c-a465-1dd2ce911303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:52.403442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efc96-6f02-4d4c-a465-1dd2ce911303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:52.405398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efc96-6f02-4d4c-a465-1dd2ce911303 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-2a5efc96-6f02-4d4c-a465-1dd2ce911303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:52.424601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:52.425625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:52.426599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:52.426599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:52.426599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:52.426599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 607/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:52.434733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ed2d0-8c43-424c-b745-64bcb8522db3 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:52.550245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710ed2d0-8c43-424c-b745-64bcb8522db3 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:52.552601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:52.592762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e615c-bbac-4c18-9d84-e17ff7684d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:52.593382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e615c-bbac-4c18-9d84-e17ff7684d92 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:52.593831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e615c-bbac-4c18-9d84-e17ff7684d92 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:52.594100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e615c-bbac-4c18-9d84-e17ff7684d92 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:52.595039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e615c-bbac-4c18-9d84-e17ff7684d92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:52.595479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e615c-bbac-4c18-9d84-e17ff7684d92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:52.597581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e615c-bbac-4c18-9d84-e17ff7684d92 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:52.617815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 622/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:52.619385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efc96-6f02-4d4c-a465-1dd2ce911303 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:52.630290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:52.733426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efc96-6f02-4d4c-a465-1dd2ce911303 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:52.777296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdbf68-c6eb-46cb-aecb-2b84416ef9be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:52.778436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdbf68-c6eb-46cb-aecb-2b84416ef9be None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:52.778777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdbf68-c6eb-46cb-aecb-2b84416ef9be None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:52.779057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fdbf68-c6eb-46cb-aecb-2b84416ef9be None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:52.787102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdbf68-c6eb-46cb-aecb-2b84416ef9be None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:52.788565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fdbf68-c6eb-46cb-aecb-2b84416ef9be None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-60fdbf68-c6eb-46cb-aecb-2b84416ef9be None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:38:52.801545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:52.802620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:52.803636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:38:52.803636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:38:52.803636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:38:52.803636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:38:52.803636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:38:52.803636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:38:52.803636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:52.803636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:52.803636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 608/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:38:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:52.809797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e615c-bbac-4c18-9d84-e17ff7684d92 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:52.923990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e615c-bbac-4c18-9d84-e17ff7684d92 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:52.959318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba74578f-7f5b-4ebf-9d0e-e5a64ec2fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:52.959921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74578f-7f5b-4ebf-9d0e-e5a64ec2fb9f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:52.960196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74578f-7f5b-4ebf-9d0e-e5a64ec2fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:52.960483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba74578f-7f5b-4ebf-9d0e-e5a64ec2fb9f None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:52.961719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74578f-7f5b-4ebf-9d0e-e5a64ec2fb9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:52.962021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74578f-7f5b-4ebf-9d0e-e5a64ec2fb9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:52.963685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba74578f-7f5b-4ebf-9d0e-e5a64ec2fb9f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:52.975476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 623/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:38:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:52.984781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdbf68-c6eb-46cb-aecb-2b84416ef9be None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:53.057744 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:53.099354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fdbf68-c6eb-46cb-aecb-2b84416ef9be None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:53.135465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25276e58-b821-4d64-856e-215885adf617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:53.136552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25276e58-b821-4d64-856e-215885adf617 None admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:53.136822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25276e58-b821-4d64-856e-215885adf617 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:53.137110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25276e58-b821-4d64-856e-215885adf617 None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/47fef4612fbd4d00ad8de2a2144a2ba5/roles/0262a124652e4e13a6dc455c2cc2ffb7` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:53.155092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25276e58-b821-4d64-856e-215885adf617 None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=47fef4612fbd4d00ad8de2a2144a2ba5, role_id=0262a124652e4e13a6dc455c2cc2ffb7)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:53.156746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25276e58-b821-4d64-856e-215885adf617 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:53.171062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 609/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:38:52 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/47fef4612fbd4d00ad8de2a2144a2ba5/roles/0262a124652e4e13a6dc455c2cc2ffb7 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:38:55.521905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0bb09-0903-4980-8a0f-443f9ab922e2 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:55.522474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0bb09-0903-4980-8a0f-443f9ab922e2 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:55.522474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e0bb09-0903-4980-8a0f-443f9ab922e2 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:55.524367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 624/1233] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:38:55.531066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003b692-182b-4e9c-8045-3667394a71d2 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:55.531583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003b692-182b-4e9c-8045-3667394a71d2 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:55.531710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003b692-182b-4e9c-8045-3667394a71d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:55.552243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9003b692-182b-4e9c-8045-3667394a71d2 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:38:55.553588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9003b692-182b-4e9c-8045-3667394a71d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:38:55.624694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 610/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:38:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:38:55.930707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0bb09-0903-4980-8a0f-443f9ab922e2 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:55.957143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:56.049164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e0bb09-0903-4980-8a0f-443f9ab922e2 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:56.087664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64374-e25f-4d69-aa96-1aef8ab69adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:56.088841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64374-e25f-4d69-aa96-1aef8ab69adf None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:56.089228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64374-e25f-4d69-aa96-1aef8ab69adf None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:56.089635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f64374-e25f-4d69-aa96-1aef8ab69adf None admin] PATH_INFO: `/v3/roles/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:56.101250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f64374-e25f-4d69-aa96-1aef8ab69adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-66f64374-e25f-4d69-aa96-1aef8ab69adf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:38:56.106867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:56.108047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:38:56.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 625/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 17 00:38:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:56.114329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003b692-182b-4e9c-8045-3667394a71d2 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:56.166439 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:56.222799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003b692-182b-4e9c-8045-3667394a71d2 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:56.260929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2ea4f-2609-4c14-8b87-cd7adadbc1c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:56.261576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2ea4f-2609-4c14-8b87-cd7adadbc1c7 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:56.261858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2ea4f-2609-4c14-8b87-cd7adadbc1c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:56.262132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2ea4f-2609-4c14-8b87-cd7adadbc1c7 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:56.262805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2ea4f-2609-4c14-8b87-cd7adadbc1c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:56.263108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2ea4f-2609-4c14-8b87-cd7adadbc1c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:56.264479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b2ea4f-2609-4c14-8b87-cd7adadbc1c7 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:56.273940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 611/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 17 00:38:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:56.279836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64374-e25f-4d69-aa96-1aef8ab69adf None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:56.382832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:56.399538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f64374-e25f-4d69-aa96-1aef8ab69adf None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:56.439483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0d2a9-c8cc-4066-80f7-df5a7123566e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:56.440118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0d2a9-c8cc-4066-80f7-df5a7123566e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:56.440424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0d2a9-c8cc-4066-80f7-df5a7123566e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:56.440726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b0d2a9-c8cc-4066-80f7-df5a7123566e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:56.451507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0d2a9-c8cc-4066-80f7-df5a7123566e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:56.452936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b0d2a9-c8cc-4066-80f7-df5a7123566e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-02b0d2a9-c8cc-4066-80f7-df5a7123566e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:56.468887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:56.469942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:56.471130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:56.471130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:56.471130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:38:56.471130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 626/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:56.476153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2ea4f-2609-4c14-8b87-cd7adadbc1c7 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:56.588278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2ea4f-2609-4c14-8b87-cd7adadbc1c7 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:56.600645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:56.638391 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7cef6-823f-48ce-98ea-f6ffaefd659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:56.639238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7cef6-823f-48ce-98ea-f6ffaefd659e None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:56.639570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7cef6-823f-48ce-98ea-f6ffaefd659e None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:56.639918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a7cef6-823f-48ce-98ea-f6ffaefd659e None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:56.640719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7cef6-823f-48ce-98ea-f6ffaefd659e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:56.641114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7cef6-823f-48ce-98ea-f6ffaefd659e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:56.642591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a7cef6-823f-48ce-98ea-f6ffaefd659e None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:56.655241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 612/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:56.661330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0d2a9-c8cc-4066-80f7-df5a7123566e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:56.768136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b0d2a9-c8cc-4066-80f7-df5a7123566e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:56.807621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29184ce7-4f18-4784-94bd-f4fff7f1ba52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:56.808245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29184ce7-4f18-4784-94bd-f4fff7f1ba52 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:56.808520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29184ce7-4f18-4784-94bd-f4fff7f1ba52 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:56.808788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29184ce7-4f18-4784-94bd-f4fff7f1ba52 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:56.811700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:56.817791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29184ce7-4f18-4784-94bd-f4fff7f1ba52 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:56.820782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29184ce7-4f18-4784-94bd-f4fff7f1ba52 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-29184ce7-4f18-4784-94bd-f4fff7f1ba52 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:38:56.834202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:56.835467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:38:56.836666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:38:56.837867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 627/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:56.843946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7cef6-823f-48ce-98ea-f6ffaefd659e None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:56.966433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a7cef6-823f-48ce-98ea-f6ffaefd659e None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:57.009572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89898cf-f1b6-4411-97fb-118798b07253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:57.010325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89898cf-f1b6-4411-97fb-118798b07253 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:57.010725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89898cf-f1b6-4411-97fb-118798b07253 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:57.011014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89898cf-f1b6-4411-97fb-118798b07253 None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:57.011918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89898cf-f1b6-4411-97fb-118798b07253 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:57.012285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89898cf-f1b6-4411-97fb-118798b07253 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:57.014190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89898cf-f1b6-4411-97fb-118798b07253 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:57.037038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 613/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 17 00:38:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:38:57.044077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29184ce7-4f18-4784-94bd-f4fff7f1ba52 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:57.156223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29184ce7-4f18-4784-94bd-f4fff7f1ba52 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:57.192511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577fd20-e320-4604-8a7d-75b3ceb28581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:57.193154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577fd20-e320-4604-8a7d-75b3ceb28581 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:57.193509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577fd20-e320-4604-8a7d-75b3ceb28581 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:57.193796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577fd20-e320-4604-8a7d-75b3ceb28581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:57.265859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:57.280013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577fd20-e320-4604-8a7d-75b3ceb28581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:57.281600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577fd20-e320-4604-8a7d-75b3ceb28581 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:57.395418 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 628/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:38:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:38:57.405737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89898cf-f1b6-4411-97fb-118798b07253 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:57.436358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:57.522918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89898cf-f1b6-4411-97fb-118798b07253 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:57.560734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f559da-38ff-44b6-965a-43f3a5b248ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:57.562694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f559da-38ff-44b6-965a-43f3a5b248ec None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:57.562694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f559da-38ff-44b6-965a-43f3a5b248ec None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:57.562694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f559da-38ff-44b6-965a-43f3a5b248ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:57.573446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f559da-38ff-44b6-965a-43f3a5b248ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:57.574905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f559da-38ff-44b6-965a-43f3a5b248ec None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-b5f559da-38ff-44b6-965a-43f3a5b248ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:38:57.592083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:57.598591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:38:57.599705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:38:57.599705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:38:57.599705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:57.599705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 614/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:57.600006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577fd20-e320-4604-8a7d-75b3ceb28581 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:57.711694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:57.719587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577fd20-e320-4604-8a7d-75b3ceb28581 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:57.759921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4930f0-f686-4d87-9f0d-1162144707a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:57.760641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4930f0-f686-4d87-9f0d-1162144707a6 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:57.760996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4930f0-f686-4d87-9f0d-1162144707a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:57.761274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4930f0-f686-4d87-9f0d-1162144707a6 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:57.762013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4930f0-f686-4d87-9f0d-1162144707a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:57.762369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4930f0-f686-4d87-9f0d-1162144707a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:57.763876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4930f0-f686-4d87-9f0d-1162144707a6 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:57.776489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 629/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:57.782646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f559da-38ff-44b6-965a-43f3a5b248ec None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:57.880108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:38:57.906158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f559da-38ff-44b6-965a-43f3a5b248ec None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:57.943666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430207-8399-4e55-b350-04c4072aefe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:57.944485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430207-8399-4e55-b350-04c4072aefe1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:57.944825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430207-8399-4e55-b350-04c4072aefe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:57.945219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca430207-8399-4e55-b350-04c4072aefe1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:57.956630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca430207-8399-4e55-b350-04c4072aefe1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:57.958115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca430207-8399-4e55-b350-04c4072aefe1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-ca430207-8399-4e55-b350-04c4072aefe1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:38:57.976938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:38:57.978066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:38:57.979074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:38:57.979074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:38:57.979074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:38:57.979074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:38:57.979074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:38:57.979074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:38:57.979074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:38:57.979074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:38:57.979734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 615/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:38:57.986041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4930f0-f686-4d87-9f0d-1162144707a6 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:58.105455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4930f0-f686-4d87-9f0d-1162144707a6 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:58.141564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2204baab-aa09-481a-9411-4f755a7489c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:58.142283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204baab-aa09-481a-9411-4f755a7489c8 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:58.142690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204baab-aa09-481a-9411-4f755a7489c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:58.143048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2204baab-aa09-481a-9411-4f755a7489c8 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:58.143979 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204baab-aa09-481a-9411-4f755a7489c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:58.144321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204baab-aa09-481a-9411-4f755a7489c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:58.146166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2204baab-aa09-481a-9411-4f755a7489c8 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:58.161305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 630/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:38:58.167808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430207-8399-4e55-b350-04c4072aefe1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:38:58.288228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca430207-8399-4e55-b350-04c4072aefe1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:38:58.327917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a74b7-6a35-4df4-b72d-726f17836f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:38:58.328523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a74b7-6a35-4df4-b72d-726f17836f03 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:38:58.328839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a74b7-6a35-4df4-b72d-726f17836f03 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:38:58.329134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a74b7-6a35-4df4-b72d-726f17836f03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:38:58.329860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a74b7-6a35-4df4-b72d-726f17836f03 None admin] RBAC: Adding query filter params (role.id=0262a124652e4e13a6dc455c2cc2ffb7, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=47fef4612fbd4d00ad8de2a2144a2ba5) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:38:58.330186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a74b7-6a35-4df4-b72d-726f17836f03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:38:58.331712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a74b7-6a35-4df4-b72d-726f17836f03 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:38:58.338270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 616/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:38:58 2022] GET /identity/v3/role_assignments?user.id=47fef4612fbd4d00ad8de2a2144a2ba5&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=0262a124652e4e13a6dc455c2cc2ffb7 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:00.643780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fdd2f-0e91-44a2-a808-2f8972cd4796 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:00.644327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fdd2f-0e91-44a2-a808-2f8972cd4796 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:00.644530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fdd2f-0e91-44a2-a808-2f8972cd4796 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:00.646578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 631/1247] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:39:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:00.652905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72523b2-081a-41a3-a466-dd4b4c9f0416 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:00.653317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72523b2-081a-41a3-a466-dd4b4c9f0416 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:00.653518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72523b2-081a-41a3-a466-dd4b4c9f0416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:00.660374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:00.674753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b72523b2-081a-41a3-a466-dd4b4c9f0416 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:00.675978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b72523b2-081a-41a3-a466-dd4b4c9f0416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:00.752913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 617/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:01.065185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fdd2f-0e91-44a2-a808-2f8972cd4796 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:01.090317 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:01.184924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fdd2f-0e91-44a2-a808-2f8972cd4796 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:01.220828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87aefe9-5f7a-4ad9-9cf7-460d3fdd064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:01.221655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aefe9-5f7a-4ad9-9cf7-460d3fdd064f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:01.221925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aefe9-5f7a-4ad9-9cf7-460d3fdd064f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:01.222285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87aefe9-5f7a-4ad9-9cf7-460d3fdd064f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:01.234548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87aefe9-5f7a-4ad9-9cf7-460d3fdd064f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-c87aefe9-5f7a-4ad9-9cf7-460d3fdd064f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:39:01.240097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:01.241225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:01.242800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:01.247471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 632/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:01.248765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72523b2-081a-41a3-a466-dd4b4c9f0416 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:01.368202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72523b2-081a-41a3-a466-dd4b4c9f0416 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:01.401935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:01.407921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650dd5e-7ac6-430f-8a5e-26f78932c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:01.408552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650dd5e-7ac6-430f-8a5e-26f78932c059 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:01.408830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650dd5e-7ac6-430f-8a5e-26f78932c059 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:01.409100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4650dd5e-7ac6-430f-8a5e-26f78932c059 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:01.409819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650dd5e-7ac6-430f-8a5e-26f78932c059 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:01.410120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650dd5e-7ac6-430f-8a5e-26f78932c059 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:01.411545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4650dd5e-7ac6-430f-8a5e-26f78932c059 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:01.424628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 618/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:39:01.430729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87aefe9-5f7a-4ad9-9cf7-460d3fdd064f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:01.517434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:01.544579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87aefe9-5f7a-4ad9-9cf7-460d3fdd064f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:01.580963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12540f-3c7c-46ec-9aa8-66cbde0d9f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:01.581646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12540f-3c7c-46ec-9aa8-66cbde0d9f40 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:01.581969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12540f-3c7c-46ec-9aa8-66cbde0d9f40 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:01.582271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd12540f-3c7c-46ec-9aa8-66cbde0d9f40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:01.594881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12540f-3c7c-46ec-9aa8-66cbde0d9f40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:01.596529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd12540f-3c7c-46ec-9aa8-66cbde0d9f40 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-dd12540f-3c7c-46ec-9aa8-66cbde0d9f40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:01.613303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:01.614348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:01.615247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:01.615247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:01.615247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:01.615247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 633/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:01.620742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650dd5e-7ac6-430f-8a5e-26f78932c059 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:01.739250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4650dd5e-7ac6-430f-8a5e-26f78932c059 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:01.775186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59c38-19fa-4cf8-a543-b571a4248da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:01.775813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59c38-19fa-4cf8-a543-b571a4248da8 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:01.776127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59c38-19fa-4cf8-a543-b571a4248da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:01.776425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a59c38-19fa-4cf8-a543-b571a4248da8 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:01.777093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59c38-19fa-4cf8-a543-b571a4248da8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:01.777396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59c38-19fa-4cf8-a543-b571a4248da8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:01.778877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a59c38-19fa-4cf8-a543-b571a4248da8 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:01.791888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 619/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:01.797936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12540f-3c7c-46ec-9aa8-66cbde0d9f40 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:01.904696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd12540f-3c7c-46ec-9aa8-66cbde0d9f40 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:01.934228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:01.940819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de931-9bf6-46b9-aa6a-85dc96d8d85d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:01.941528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de931-9bf6-46b9-aa6a-85dc96d8d85d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:01.941823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de931-9bf6-46b9-aa6a-85dc96d8d85d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:01.942100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530de931-9bf6-46b9-aa6a-85dc96d8d85d None admin] PATH_INFO: `/v3/users/placement` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:01.950538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530de931-9bf6-46b9-aa6a-85dc96d8d85d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:01.951986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530de931-9bf6-46b9-aa6a-85dc96d8d85d None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-530de931-9bf6-46b9-aa6a-85dc96d8d85d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:39:01.963619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:01.964587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:01.966014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 634/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:01.970932 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59c38-19fa-4cf8-a543-b571a4248da8 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:02.033196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:02.081056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a59c38-19fa-4cf8-a543-b571a4248da8 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:02.114140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3c7d0-e520-4b11-ae56-6af76db5caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:02.114735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3c7d0-e520-4b11-ae56-6af76db5caaa None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:02.115012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3c7d0-e520-4b11-ae56-6af76db5caaa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:02.115281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3c7d0-e520-4b11-ae56-6af76db5caaa None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:02.115998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3c7d0-e520-4b11-ae56-6af76db5caaa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:02.116299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3c7d0-e520-4b11-ae56-6af76db5caaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:02.118412 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3c7d0-e520-4b11-ae56-6af76db5caaa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:02.134716 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 620/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 17 00:39:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:02.140499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de931-9bf6-46b9-aa6a-85dc96d8d85d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:02.237762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530de931-9bf6-46b9-aa6a-85dc96d8d85d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:02.268665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bec5-0d54-4659-ba4e-4f85959687ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:02.269257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bec5-0d54-4659-ba4e-4f85959687ec None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:02.269570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bec5-0d54-4659-ba4e-4f85959687ec None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:02.269846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0bec5-0d54-4659-ba4e-4f85959687ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:02.321831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:02.333726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0bec5-0d54-4659-ba4e-4f85959687ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:02.335158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0bec5-0d54-4659-ba4e-4f85959687ec None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:02.428878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 635/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:39:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:39:02.435640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3c7d0-e520-4b11-ae56-6af76db5caaa None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:02.538058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3c7d0-e520-4b11-ae56-6af76db5caaa None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:02.552327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:02.575065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd61f2-c902-4ecd-b666-26c68359efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:02.575763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd61f2-c902-4ecd-b666-26c68359efd1 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:02.576080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd61f2-c902-4ecd-b666-26c68359efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:02.576356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd61f2-c902-4ecd-b666-26c68359efd1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:02.586708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd61f2-c902-4ecd-b666-26c68359efd1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:02.588159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd61f2-c902-4ecd-b666-26c68359efd1 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-e2bd61f2-c902-4ecd-b666-26c68359efd1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:02.603889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:02.604994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:02.606141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:02.606141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:02.606141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:02.606141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 621/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:02.611065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bec5-0d54-4659-ba4e-4f85959687ec None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:02.700018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:02.712067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0bec5-0d54-4659-ba4e-4f85959687ec None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:02.745279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f381dc-e87a-4fa0-9cdd-e12b66f9d34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:02.745924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f381dc-e87a-4fa0-9cdd-e12b66f9d34e None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:02.746252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f381dc-e87a-4fa0-9cdd-e12b66f9d34e None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:02.746487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f381dc-e87a-4fa0-9cdd-e12b66f9d34e None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:02.747121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f381dc-e87a-4fa0-9cdd-e12b66f9d34e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:02.747424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f381dc-e87a-4fa0-9cdd-e12b66f9d34e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:02.748777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f381dc-e87a-4fa0-9cdd-e12b66f9d34e None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:02.759566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 636/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:02.765327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd61f2-c902-4ecd-b666-26c68359efd1 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:02.869835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd61f2-c902-4ecd-b666-26c68359efd1 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:02.902310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fa321-8b8b-49ef-b71a-224491e97bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:02.902931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa321-8b8b-49ef-b71a-224491e97bda None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:02.903215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa321-8b8b-49ef-b71a-224491e97bda None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:02.903488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7fa321-8b8b-49ef-b71a-224491e97bda None admin] PATH_INFO: `/v3/projects/service` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:02.909901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fa321-8b8b-49ef-b71a-224491e97bda None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:02.911340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7fa321-8b8b-49ef-b71a-224491e97bda None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-ff7fa321-8b8b-49ef-b71a-224491e97bda None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:39:02.922188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:02.923202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:02.924195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:39:02.924195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:39:02.924195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:39:02.924195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:39:02.924195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:39:02.924195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:39:02.924195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:02.924195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:02.924195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 622/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:39:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:02.929758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f381dc-e87a-4fa0-9cdd-e12b66f9d34e None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:03.039279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f381dc-e87a-4fa0-9cdd-e12b66f9d34e None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:03.076635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c38ce25-4e54-45ef-9b01-208fc02cb139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:03.077238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38ce25-4e54-45ef-9b01-208fc02cb139 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:03.077555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38ce25-4e54-45ef-9b01-208fc02cb139 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:03.077827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c38ce25-4e54-45ef-9b01-208fc02cb139 None admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:03.078510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38ce25-4e54-45ef-9b01-208fc02cb139 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:03.078815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38ce25-4e54-45ef-9b01-208fc02cb139 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:03.080225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c38ce25-4e54-45ef-9b01-208fc02cb139 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:03.091946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 637/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:39:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:39:03.097958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fa321-8b8b-49ef-b71a-224491e97bda None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:03.123738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:03.195858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7fa321-8b8b-49ef-b71a-224491e97bda None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:03.227465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7af37f0-5f2f-40b8-8828-9ed09c660289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:03.228054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af37f0-5f2f-40b8-8828-9ed09c660289 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:03.228332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af37f0-5f2f-40b8-8828-9ed09c660289 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:03.228605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7af37f0-5f2f-40b8-8828-9ed09c660289 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:03.229322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af37f0-5f2f-40b8-8828-9ed09c660289 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=47fef4612fbd4d00ad8de2a2144a2ba5) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:03.229661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af37f0-5f2f-40b8-8828-9ed09c660289 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:03.231084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7af37f0-5f2f-40b8-8828-9ed09c660289 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:03.236203 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 623/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:39:03 2022] GET /identity/v3/role_assignments?user.id=47fef4612fbd4d00ad8de2a2144a2ba5&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:05.314198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34d947-50e7-4d40-a038-b5cd52c3a632 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:05.314756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34d947-50e7-4d40-a038-b5cd52c3a632 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:05.314756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34d947-50e7-4d40-a038-b5cd52c3a632 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:05.316068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 638/1261] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:05.321672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacabfe-eb74-426e-b513-2006d1f356e7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:05.322061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacabfe-eb74-426e-b513-2006d1f356e7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:05.322218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bacabfe-eb74-426e-b513-2006d1f356e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:05.340824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-4bacabfe-eb74-426e-b513-2006d1f356e7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:05.342033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4bacabfe-eb74-426e-b513-2006d1f356e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:05.405483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 624/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:05.669615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34d947-50e7-4d40-a038-b5cd52c3a632 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:05.680373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:05.767140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34d947-50e7-4d40-a038-b5cd52c3a632 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:05.799033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f37cb-8528-42a5-b1f1-29df113c6e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:05.799643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f37cb-8528-42a5-b1f1-29df113c6e2d None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:05.799919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f37cb-8528-42a5-b1f1-29df113c6e2d None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:05.800189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5f37cb-8528-42a5-b1f1-29df113c6e2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:05.809752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5f37cb-8528-42a5-b1f1-29df113c6e2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-ef5f37cb-8528-42a5-b1f1-29df113c6e2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:39:05.814406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:05.815502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:05.816542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 639/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:39:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:05.821809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacabfe-eb74-426e-b513-2006d1f356e7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:05.840082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:05.917164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bacabfe-eb74-426e-b513-2006d1f356e7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:05.950493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971f046-04cb-4c5f-a70d-edde5fce9357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:05.951032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971f046-04cb-4c5f-a70d-edde5fce9357 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:05.951309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971f046-04cb-4c5f-a70d-edde5fce9357 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:05.951581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971f046-04cb-4c5f-a70d-edde5fce9357 None admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:05.952239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971f046-04cb-4c5f-a70d-edde5fce9357 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:05.952538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971f046-04cb-4c5f-a70d-edde5fce9357 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:05.953938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971f046-04cb-4c5f-a70d-edde5fce9357 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:05.961629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 625/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:39:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:05.967686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f37cb-8528-42a5-b1f1-29df113c6e2d None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:06.046414 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:06.085526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5f37cb-8528-42a5-b1f1-29df113c6e2d None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:06.117740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540977a-bb54-4e3d-b64b-82dd032b4808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:06.118358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540977a-bb54-4e3d-b64b-82dd032b4808 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:06.118630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540977a-bb54-4e3d-b64b-82dd032b4808 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:06.118895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540977a-bb54-4e3d-b64b-82dd032b4808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:06.128815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540977a-bb54-4e3d-b64b-82dd032b4808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:06.130263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0540977a-bb54-4e3d-b64b-82dd032b4808 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-0540977a-bb54-4e3d-b64b-82dd032b4808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:06.144279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:06.145430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:06.146520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:06.146520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:06.146520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:06.146520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 640/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:06.151126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971f046-04cb-4c5f-a70d-edde5fce9357 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:06.229020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:06.248283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971f046-04cb-4c5f-a70d-edde5fce9357 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:06.281065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeefdfe-33ff-4481-b027-09ea25c5caba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:06.281692 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeefdfe-33ff-4481-b027-09ea25c5caba None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:06.281974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeefdfe-33ff-4481-b027-09ea25c5caba None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:06.282247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeefdfe-33ff-4481-b027-09ea25c5caba None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:06.282881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeefdfe-33ff-4481-b027-09ea25c5caba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:06.283185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeefdfe-33ff-4481-b027-09ea25c5caba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:06.284549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeefdfe-33ff-4481-b027-09ea25c5caba None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:06.295723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 626/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:06.301342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540977a-bb54-4e3d-b64b-82dd032b4808 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:06.402918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540977a-bb54-4e3d-b64b-82dd032b4808 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:06.422314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:06.437286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c06ca3-8114-4743-9968-c705e920e5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:06.437941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c06ca3-8114-4743-9968-c705e920e5bd None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:06.438222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c06ca3-8114-4743-9968-c705e920e5bd None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:06.438494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c06ca3-8114-4743-9968-c705e920e5bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:06.445817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c06ca3-8114-4743-9968-c705e920e5bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:06.447243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c06ca3-8114-4743-9968-c705e920e5bd None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-27c06ca3-8114-4743-9968-c705e920e5bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:39:06.457928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:06.458987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:06.460334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 641/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:06.465142 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeefdfe-33ff-4481-b027-09ea25c5caba None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:06.559577 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeefdfe-33ff-4481-b027-09ea25c5caba None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:06.591373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4e0fd-15c5-41d1-9b30-eb14206dbf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:06.591955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4e0fd-15c5-41d1-9b30-eb14206dbf7c None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:06.592230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4e0fd-15c5-41d1-9b30-eb14206dbf7c None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:06.592498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4e0fd-15c5-41d1-9b30-eb14206dbf7c None admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:06.593207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4e0fd-15c5-41d1-9b30-eb14206dbf7c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:06.593536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4e0fd-15c5-41d1-9b30-eb14206dbf7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:06.594942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4e0fd-15c5-41d1-9b30-eb14206dbf7c None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:06.603586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:06.611857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 627/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 17 00:39:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:06.618168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c06ca3-8114-4743-9968-c705e920e5bd None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:06.716063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c06ca3-8114-4743-9968-c705e920e5bd None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:06.749084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bc35a-7e42-46ed-9fe2-83719900948a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:06.749738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bc35a-7e42-46ed-9fe2-83719900948a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:06.750015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bc35a-7e42-46ed-9fe2-83719900948a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:06.750286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08bc35a-7e42-46ed-9fe2-83719900948a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:06.760222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bc35a-7e42-46ed-9fe2-83719900948a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:06.761669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08bc35a-7e42-46ed-9fe2-83719900948a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-a08bc35a-7e42-46ed-9fe2-83719900948a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:06.775513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:06.776678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:06.777752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:06.777752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:06.777752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:06.777752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 642/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:06.782285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4e0fd-15c5-41d1-9b30-eb14206dbf7c None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:06.878150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4e0fd-15c5-41d1-9b30-eb14206dbf7c None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:06.910984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951d7d8-7d67-4d1e-a482-9d051f0c8725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:06.911579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951d7d8-7d67-4d1e-a482-9d051f0c8725 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:06.911858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951d7d8-7d67-4d1e-a482-9d051f0c8725 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:06.912131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1951d7d8-7d67-4d1e-a482-9d051f0c8725 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:06.912769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951d7d8-7d67-4d1e-a482-9d051f0c8725 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:06.913071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951d7d8-7d67-4d1e-a482-9d051f0c8725 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:06.915110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1951d7d8-7d67-4d1e-a482-9d051f0c8725 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:06.925779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 628/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:06.931463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bc35a-7e42-46ed-9fe2-83719900948a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:06.962306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:07.031844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08bc35a-7e42-46ed-9fe2-83719900948a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:07.065157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f790c-8545-46ca-844c-10aeb866edb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:07.065875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f790c-8545-46ca-844c-10aeb866edb2 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:07.066159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f790c-8545-46ca-844c-10aeb866edb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:07.066435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f790c-8545-46ca-844c-10aeb866edb2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:07.072844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f790c-8545-46ca-844c-10aeb866edb2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:07.074312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f790c-8545-46ca-844c-10aeb866edb2 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-ed4f790c-8545-46ca-844c-10aeb866edb2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:39:07.085273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:07.086353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:07.087302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:39:07.087302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:39:07.087302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:39:07.087302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:39:07.087302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:39:07.087302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:39:07.087302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:07.087302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:07.087302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 643/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:39:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:07.092420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951d7d8-7d67-4d1e-a482-9d051f0c8725 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:07.149976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:07.190377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1951d7d8-7d67-4d1e-a482-9d051f0c8725 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:07.222706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f07384-406e-4486-981a-5db6173c2b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:07.223296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f07384-406e-4486-981a-5db6173c2b32 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:07.223570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f07384-406e-4486-981a-5db6173c2b32 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:07.223839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f07384-406e-4486-981a-5db6173c2b32 None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:07.224518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f07384-406e-4486-981a-5db6173c2b32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:07.224818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f07384-406e-4486-981a-5db6173c2b32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:07.226756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f07384-406e-4486-981a-5db6173c2b32 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:07.238099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 629/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:39:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:07.244487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f790c-8545-46ca-844c-10aeb866edb2 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:07.333467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:07.342778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f790c-8545-46ca-844c-10aeb866edb2 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:07.375430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5902e16-d8ba-4e8e-a444-275e9fe3a68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:07.376076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5902e16-d8ba-4e8e-a444-275e9fe3a68f None admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:07.376356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5902e16-d8ba-4e8e-a444-275e9fe3a68f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:07.376631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5902e16-d8ba-4e8e-a444-275e9fe3a68f None admin] PATH_INFO: `/v3/projects/51038cfbfdda4940b003287fce823318/users/47fef4612fbd4d00ad8de2a2144a2ba5/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:07.378523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5902e16-d8ba-4e8e-a444-275e9fe3a68f None admin] RBAC: Authorizing `identity:create_grant(project_id=51038cfbfdda4940b003287fce823318, user_id=47fef4612fbd4d00ad8de2a2144a2ba5, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:07.379955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5902e16-d8ba-4e8e-a444-275e9fe3a68f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:07.392201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 644/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 17 00:39:07 2022] PUT /identity/v3/projects/51038cfbfdda4940b003287fce823318/users/47fef4612fbd4d00ad8de2a2144a2ba5/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:39:09.486479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3377b57-332a-469e-9d78-05ea5c0e19a1 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:09.486984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3377b57-332a-469e-9d78-05ea5c0e19a1 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:09.487085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3377b57-332a-469e-9d78-05ea5c0e19a1 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:09.488362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 630/1274] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:09.494088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db389a0-b955-4e12-b778-50d4473cebc8 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:09.494452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db389a0-b955-4e12-b778-50d4473cebc8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:09.494629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db389a0-b955-4e12-b778-50d4473cebc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:09.512380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0db389a0-b955-4e12-b778-50d4473cebc8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:09.513593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0db389a0-b955-4e12-b778-50d4473cebc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:09.577843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 645/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:09.845614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3377b57-332a-469e-9d78-05ea5c0e19a1 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:09.942543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3377b57-332a-469e-9d78-05ea5c0e19a1 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:09.958812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:09.976645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3c225-6db1-4a37-aad9-4e45a37f0956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:09.977315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3c225-6db1-4a37-aad9-4e45a37f0956 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:09.977633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3c225-6db1-4a37-aad9-4e45a37f0956 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:09.977910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae3c225-6db1-4a37-aad9-4e45a37f0956 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:09.988036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae3c225-6db1-4a37-aad9-4e45a37f0956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-0ae3c225-6db1-4a37-aad9-4e45a37f0956 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 17 00:39:09.992885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:09.993988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:09.994850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 631/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 17 00:39:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:10.000640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db389a0-b955-4e12-b778-50d4473cebc8 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:10.094321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:10.112707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db389a0-b955-4e12-b778-50d4473cebc8 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:10.144915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6aa2d-1f6c-4d62-af52-4ad82f265d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:10.145542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6aa2d-1f6c-4d62-af52-4ad82f265d3f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:10.145824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6aa2d-1f6c-4d62-af52-4ad82f265d3f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:10.146100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc6aa2d-1f6c-4d62-af52-4ad82f265d3f None admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:10.146762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6aa2d-1f6c-4d62-af52-4ad82f265d3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:10.147064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6aa2d-1f6c-4d62-af52-4ad82f265d3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:10.148974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc6aa2d-1f6c-4d62-af52-4ad82f265d3f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:10.156644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 646/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 17 00:39:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:10.162483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3c225-6db1-4a37-aad9-4e45a37f0956 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:10.258751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae3c225-6db1-4a37-aad9-4e45a37f0956 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:10.291927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdf730-f1bb-44e1-b273-b6d144a99aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:10.292535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdf730-f1bb-44e1-b273-b6d144a99aeb None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:10.292814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdf730-f1bb-44e1-b273-b6d144a99aeb None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:10.293088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efdf730-f1bb-44e1-b273-b6d144a99aeb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:10.302690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdf730-f1bb-44e1-b273-b6d144a99aeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:10.304689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efdf730-f1bb-44e1-b273-b6d144a99aeb None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-5efdf730-f1bb-44e1-b273-b6d144a99aeb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:10.318602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:10.319745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:10.320861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:10.320861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:10.320861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:10.320861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 632/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:10.325365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6aa2d-1f6c-4d62-af52-4ad82f265d3f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:10.422798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc6aa2d-1f6c-4d62-af52-4ad82f265d3f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:10.454480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddcd62-38f5-4a7c-b07c-2ebc69427865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:10.455072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddcd62-38f5-4a7c-b07c-2ebc69427865 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:10.455348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddcd62-38f5-4a7c-b07c-2ebc69427865 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:10.455617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ddcd62-38f5-4a7c-b07c-2ebc69427865 None admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:10.456249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddcd62-38f5-4a7c-b07c-2ebc69427865 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:10.456551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddcd62-38f5-4a7c-b07c-2ebc69427865 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:10.457931 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ddcd62-38f5-4a7c-b07c-2ebc69427865 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:10.469843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 647/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:10.475510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdf730-f1bb-44e1-b273-b6d144a99aeb None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:10.508970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:10.577307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efdf730-f1bb-44e1-b273-b6d144a99aeb None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:10.610683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017edcd9-d57a-4c6c-bb49-dd3c002e8963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:10.611297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017edcd9-d57a-4c6c-bb49-dd3c002e8963 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:10.611579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017edcd9-d57a-4c6c-bb49-dd3c002e8963 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:10.611855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017edcd9-d57a-4c6c-bb49-dd3c002e8963 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:10.619219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017edcd9-d57a-4c6c-bb49-dd3c002e8963 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:10.620654 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017edcd9-d57a-4c6c-bb49-dd3c002e8963 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-017edcd9-d57a-4c6c-bb49-dd3c002e8963 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 17 00:39:10.631486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:10.633386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:10.634659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 633/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:10.638430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddcd62-38f5-4a7c-b07c-2ebc69427865 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:10.642197 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:10.734928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ddcd62-38f5-4a7c-b07c-2ebc69427865 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:10.767016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39cb49-ddc1-435a-934c-6ebee362b86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:10.767615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39cb49-ddc1-435a-934c-6ebee362b86f None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:10.767892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39cb49-ddc1-435a-934c-6ebee362b86f None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:10.768163 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a39cb49-ddc1-435a-934c-6ebee362b86f None admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:10.768883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39cb49-ddc1-435a-934c-6ebee362b86f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:10.769187 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39cb49-ddc1-435a-934c-6ebee362b86f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:10.770625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a39cb49-ddc1-435a-934c-6ebee362b86f None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:10.787606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 648/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 17 00:39:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:10.794113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017edcd9-d57a-4c6c-bb49-dd3c002e8963 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:10.883108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:10.892693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017edcd9-d57a-4c6c-bb49-dd3c002e8963 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:10.925028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb323b-615b-4a03-959b-487e7350fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:10.925644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb323b-615b-4a03-959b-487e7350fb54 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:10.925919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb323b-615b-4a03-959b-487e7350fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:10.926185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb323b-615b-4a03-959b-487e7350fb54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:10.990191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb323b-615b-4a03-959b-487e7350fb54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:10.992208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cb323b-615b-4a03-959b-487e7350fb54 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:11.079403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:11.090058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 634/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 17 00:39:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 17 00:39:11.095942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39cb49-ddc1-435a-934c-6ebee362b86f None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:11.158162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:11.195477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a39cb49-ddc1-435a-934c-6ebee362b86f None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:11.228531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f5f6e-e921-4463-a074-da6e29d03c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:11.229156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f5f6e-e921-4463-a074-da6e29d03c3a None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:11.229464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f5f6e-e921-4463-a074-da6e29d03c3a None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:11.229737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f5f6e-e921-4463-a074-da6e29d03c3a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:11.239919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f5f6e-e921-4463-a074-da6e29d03c3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:11.241439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f5f6e-e921-4463-a074-da6e29d03c3a None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-6e0f5f6e-e921-4463-a074-da6e29d03c3a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 17 00:39:11.255226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:11.256356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 17 00:39:11.257493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 17 00:39:11.257493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 17 00:39:11.257493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:11.257493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 649/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:11.262214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb323b-615b-4a03-959b-487e7350fb54 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:11.357608 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cb323b-615b-4a03-959b-487e7350fb54 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:11.389579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdc7e4-777d-42e6-bed5-283dde4a9f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:11.390172 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdc7e4-777d-42e6-bed5-283dde4a9f98 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:11.390450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdc7e4-777d-42e6-bed5-283dde4a9f98 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:11.390730 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbdc7e4-777d-42e6-bed5-283dde4a9f98 None admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:11.391359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdc7e4-777d-42e6-bed5-283dde4a9f98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:11.391658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdc7e4-777d-42e6-bed5-283dde4a9f98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:11.393017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbdc7e4-777d-42e6-bed5-283dde4a9f98 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:11.404196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 635/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 17 00:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:11.409610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f5f6e-e921-4463-a074-da6e29d03c3a None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:11.517594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f5f6e-e921-4463-a074-da6e29d03c3a None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:11.531029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:11.550708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea59205-6188-472b-bb87-a67e59399902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:11.551328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59205-6188-472b-bb87-a67e59399902 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:11.551608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59205-6188-472b-bb87-a67e59399902 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:11.551881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea59205-6188-472b-bb87-a67e59399902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:11.558240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea59205-6188-472b-bb87-a67e59399902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:11.559672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea59205-6188-472b-bb87-a67e59399902 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application [None req-cea59205-6188-472b-bb87-a67e59399902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 17 00:39:11.571021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:11.572072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:11.573006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 17 00:39:11.573006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 17 00:39:11.573006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 17 00:39:11.573006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 17 00:39:11.573006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 17 00:39:11.573006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 17 00:39:11.573006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 17 00:39:11.573006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: ERROR keystone.server.flask.application Sep 17 00:39:11.573006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 650/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 17 00:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:11.577925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdc7e4-777d-42e6-bed5-283dde4a9f98 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:11.626051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:11.674261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbdc7e4-777d-42e6-bed5-283dde4a9f98 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:11.706394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36213e9-e6f8-4949-850a-f03e38c05dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:11.706985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36213e9-e6f8-4949-850a-f03e38c05dfc None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:11.707263 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36213e9-e6f8-4949-850a-f03e38c05dfc None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:11.707543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36213e9-e6f8-4949-850a-f03e38c05dfc None admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:11.708224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36213e9-e6f8-4949-850a-f03e38c05dfc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:11.708529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36213e9-e6f8-4949-850a-f03e38c05dfc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:11.709985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36213e9-e6f8-4949-850a-f03e38c05dfc None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:11.722300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 636/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 17 00:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:11.728740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea59205-6188-472b-bb87-a67e59399902 None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:11.832516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea59205-6188-472b-bb87-a67e59399902 None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:11.864378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29fd237-ec78-4855-ad78-9137545e8310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:11.864963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fd237-ec78-4855-ad78-9137545e8310 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:11.865241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fd237-ec78-4855-ad78-9137545e8310 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:11.865541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29fd237-ec78-4855-ad78-9137545e8310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:11.866258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fd237-ec78-4855-ad78-9137545e8310 None admin] RBAC: Adding query filter params (role.id=b2ca49dcc2ea4114875e545bc537bfb0, scope.project.id=51038cfbfdda4940b003287fce823318, user.id=47fef4612fbd4d00ad8de2a2144a2ba5) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:11.867093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fd237-ec78-4855-ad78-9137545e8310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:11.868501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29fd237-ec78-4855-ad78-9137545e8310 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:11.874013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 651/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 17 00:39:11 2022] GET /identity/v3/role_assignments?user.id=47fef4612fbd4d00ad8de2a2144a2ba5&scope.project.id=51038cfbfdda4940b003287fce823318&role.id=b2ca49dcc2ea4114875e545bc537bfb0 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:13.990605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43949a9a-b8aa-479d-bbca-9991f024aee0 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:13.991129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43949a9a-b8aa-479d-bbca-9991f024aee0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:13.991129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43949a9a-b8aa-479d-bbca-9991f024aee0 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:13.993063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 637/1288] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:13.998148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640686f-f988-418d-bfe5-52504639f08c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:13.998721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640686f-f988-418d-bfe5-52504639f08c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:13.998721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e640686f-f988-418d-bfe5-52504639f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:14.018897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e640686f-f988-418d-bfe5-52504639f08c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:14.020212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e640686f-f988-418d-bfe5-52504639f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:14.053438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:14.095489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 652/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:14.360099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43949a9a-b8aa-479d-bbca-9991f024aee0 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:14.457346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43949a9a-b8aa-479d-bbca-9991f024aee0 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:14.468626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:14.492572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19470fa3-ceb0-4a4e-8639-3dc7a85395aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:14.493223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19470fa3-ceb0-4a4e-8639-3dc7a85395aa None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:14.493544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19470fa3-ceb0-4a4e-8639-3dc7a85395aa None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:14.493852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19470fa3-ceb0-4a4e-8639-3dc7a85395aa None admin] PATH_INFO: `/v3/services/placement` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:14.494436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19470fa3-ceb0-4a4e-8639-3dc7a85395aa None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:14.495825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19470fa3-ceb0-4a4e-8639-3dc7a85395aa None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-19470fa3-ceb0-4a4e-8639-3dc7a85395aa None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:14.504409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:14.505622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:14.506700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 638/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:39:14 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:14.512098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640686f-f988-418d-bfe5-52504639f08c None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:14.606121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e640686f-f988-418d-bfe5-52504639f08c None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:14.638461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b2f4d-7e21-4efb-b92b-261e9214fc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:14.639007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b2f4d-7e21-4efb-b92b-261e9214fc10 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:14.639285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b2f4d-7e21-4efb-b92b-261e9214fc10 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:14.639558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b2f4d-7e21-4efb-b92b-261e9214fc10 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:14.640182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b2f4d-7e21-4efb-b92b-261e9214fc10 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:14.640483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b2f4d-7e21-4efb-b92b-261e9214fc10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:14.641861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b2f4d-7e21-4efb-b92b-261e9214fc10 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:14.646488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 653/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 17 00:39:14 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:14.652662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19470fa3-ceb0-4a4e-8639-3dc7a85395aa None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:14.750635 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19470fa3-ceb0-4a4e-8639-3dc7a85395aa None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:14.783012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588c0a0d-474e-49c9-a2bd-b7b3544c6266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:14.783597 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c0a0d-474e-49c9-a2bd-b7b3544c6266 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:14.783872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c0a0d-474e-49c9-a2bd-b7b3544c6266 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:14.784141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588c0a0d-474e-49c9-a2bd-b7b3544c6266 None admin] PATH_INFO: `/v3/services` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:14.784757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c0a0d-474e-49c9-a2bd-b7b3544c6266 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:14.785060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c0a0d-474e-49c9-a2bd-b7b3544c6266 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:14.786443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588c0a0d-474e-49c9-a2bd-b7b3544c6266 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:14.790685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 639/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 17 00:39:14 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:16.894724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4045c56-4cbc-49d0-affc-b537d7db15ef None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:16.895261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4045c56-4cbc-49d0-affc-b537d7db15ef None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:16.895261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4045c56-4cbc-49d0-affc-b537d7db15ef None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:16.896646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 654/1293] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:16.901845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2631a-32ac-4f5e-bc49-34804d258745 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:16.902257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2631a-32ac-4f5e-bc49-34804d258745 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:16.902398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d2631a-32ac-4f5e-bc49-34804d258745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:16.920533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-69d2631a-32ac-4f5e-bc49-34804d258745 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:16.921768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-69d2631a-32ac-4f5e-bc49-34804d258745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:16.950836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:16.986817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 640/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:17.258583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4045c56-4cbc-49d0-affc-b537d7db15ef None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:17.289483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:17.358895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4045c56-4cbc-49d0-affc-b537d7db15ef None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:17.390685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b611eb6-efc9-4242-b953-e75f5ba0d954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:17.391289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611eb6-efc9-4242-b953-e75f5ba0d954 None admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:17.391569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611eb6-efc9-4242-b953-e75f5ba0d954 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:17.391844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b611eb6-efc9-4242-b953-e75f5ba0d954 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:17.392531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b611eb6-efc9-4242-b953-e75f5ba0d954 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:17.393922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b611eb6-efc9-4242-b953-e75f5ba0d954 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:17.407930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 655/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 17 00:39:17 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:39:19.520052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68515a6-03e7-47b3-aa4c-135b53d94a2c None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:19.520614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68515a6-03e7-47b3-aa4c-135b53d94a2c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:19.520614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68515a6-03e7-47b3-aa4c-135b53d94a2c None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:19.521968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 641/1296] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:19.527241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81b611-f7e2-4677-99ee-93fc81454c56 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:19.527626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81b611-f7e2-4677-99ee-93fc81454c56 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:19.527796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c81b611-f7e2-4677-99ee-93fc81454c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:19.545533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2c81b611-f7e2-4677-99ee-93fc81454c56 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:19.546724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2c81b611-f7e2-4677-99ee-93fc81454c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:19.617163 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 656/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:19 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:19.883688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68515a6-03e7-47b3-aa4c-135b53d94a2c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:19.981004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68515a6-03e7-47b3-aa4c-135b53d94a2c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:20.014929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8b555-3802-46b7-bfdd-9ded761305f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:20.015556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8b555-3802-46b7-bfdd-9ded761305f9 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:20.015832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8b555-3802-46b7-bfdd-9ded761305f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:20.016108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b8b555-3802-46b7-bfdd-9ded761305f9 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:20.016688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8b555-3802-46b7-bfdd-9ded761305f9 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:20.018082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b8b555-3802-46b7-bfdd-9ded761305f9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-d0b8b555-3802-46b7-bfdd-9ded761305f9 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:20.027461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:20.028586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:20.029467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 642/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:39:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:20.034804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81b611-f7e2-4677-99ee-93fc81454c56 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:20.053459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:20.132912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c81b611-f7e2-4677-99ee-93fc81454c56 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:20.166311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effe2ae-9d31-4f3e-9921-1c044b0fa6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:20.166854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effe2ae-9d31-4f3e-9921-1c044b0fa6cd None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:20.167135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effe2ae-9d31-4f3e-9921-1c044b0fa6cd None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:20.167412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effe2ae-9d31-4f3e-9921-1c044b0fa6cd None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:20.168039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effe2ae-9d31-4f3e-9921-1c044b0fa6cd None admin] RBAC: Adding query filter params (name=placement) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:20.168343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effe2ae-9d31-4f3e-9921-1c044b0fa6cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:20.169733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effe2ae-9d31-4f3e-9921-1c044b0fa6cd None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:20.174690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 657/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 17 00:39:20 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:39:20.180959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8b555-3802-46b7-bfdd-9ded761305f9 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:20.211592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:20.277691 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b8b555-3802-46b7-bfdd-9ded761305f9 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:20.309854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75e8163-7352-47f9-8ac2-422aa970423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:20.310442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e8163-7352-47f9-8ac2-422aa970423b None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:20.310717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e8163-7352-47f9-8ac2-422aa970423b None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:20.310987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e8163-7352-47f9-8ac2-422aa970423b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:20.311676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e8163-7352-47f9-8ac2-422aa970423b None admin] RBAC: Adding query filter params (interface=public, service_id=e9d2a7aeb7b8405088e85205e4c98341, region_id=RegionOne) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:20.311980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e8163-7352-47f9-8ac2-422aa970423b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:20.313334 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75e8163-7352-47f9-8ac2-422aa970423b None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:20.318127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 643/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 17 00:39:20 2022] GET /identity/v3/endpoints?service_id=e9d2a7aeb7b8405088e85205e4c98341&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:20.323671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effe2ae-9d31-4f3e-9921-1c044b0fa6cd None admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:20.402594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:20.421610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effe2ae-9d31-4f3e-9921-1c044b0fa6cd None admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:20.453835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca197c-cde9-4edc-b8ff-18cb69e44684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:20.454430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca197c-cde9-4edc-b8ff-18cb69e44684 None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:20.454708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca197c-cde9-4edc-b8ff-18cb69e44684 None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:20.454978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca197c-cde9-4edc-b8ff-18cb69e44684 None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:20.455573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca197c-cde9-4edc-b8ff-18cb69e44684 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:20.456909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca197c-cde9-4edc-b8ff-18cb69e44684 None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:20.464312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 658/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 17 00:39:20 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:39:22.602374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601934d5-7a98-471a-83e4-d93bbf818e38 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:22.602999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601934d5-7a98-471a-83e4-d93bbf818e38 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:22.602999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601934d5-7a98-471a-83e4-d93bbf818e38 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:22.604261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 644/1302] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:39:22.609326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41838ee-d6bc-466c-857f-c46cdf5ad131 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:22.609714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41838ee-d6bc-466c-857f-c46cdf5ad131 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:22.609920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41838ee-d6bc-466c-857f-c46cdf5ad131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:22.627576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b41838ee-d6bc-466c-857f-c46cdf5ad131 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:39:22.628763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b41838ee-d6bc-466c-857f-c46cdf5ad131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:39:22.692057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 659/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:39:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 17 00:39:22.957837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601934d5-7a98-471a-83e4-d93bbf818e38 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:23.050773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:23.057709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601934d5-7a98-471a-83e4-d93bbf818e38 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:23.090739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e282f66-2d28-4afa-9c47-cf09aa7c5723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:23.091362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e282f66-2d28-4afa-9c47-cf09aa7c5723 None admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:23.091641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e282f66-2d28-4afa-9c47-cf09aa7c5723 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:23.091914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e282f66-2d28-4afa-9c47-cf09aa7c5723 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:23.092525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e282f66-2d28-4afa-9c47-cf09aa7c5723 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:23.093918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e282f66-2d28-4afa-9c47-cf09aa7c5723 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application [None req-7e282f66-2d28-4afa-9c47-cf09aa7c5723 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 17 00:39:23.102433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 17 00:39:23.103590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.get_or_create( Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application with Lock( Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self._enter() Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application return self.creator() Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application created_value = creator( Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: ERROR keystone.server.flask.application Sep 17 00:39:23.104431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 645/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 17 00:39:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 17 00:39:23.109495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41838ee-d6bc-466c-857f-c46cdf5ad131 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:23.182509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:23.205233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41838ee-d6bc-466c-857f-c46cdf5ad131 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:23.238090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50319d1d-55a5-4f22-9cc4-b54d774e967b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:23.238633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50319d1d-55a5-4f22-9cc4-b54d774e967b None admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:23.238917 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50319d1d-55a5-4f22-9cc4-b54d774e967b None admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:23.239193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50319d1d-55a5-4f22-9cc4-b54d774e967b None admin] PATH_INFO: `/v3/services` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:23.239827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50319d1d-55a5-4f22-9cc4-b54d774e967b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:39:23.240131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50319d1d-55a5-4f22-9cc4-b54d774e967b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:23.242032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50319d1d-55a5-4f22-9cc4-b54d774e967b None admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:23.247012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 660/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 17 00:39:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:39:23.252708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e282f66-2d28-4afa-9c47-cf09aa7c5723 None admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:39:23.348771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e282f66-2d28-4afa-9c47-cf09aa7c5723 None admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:39:23.381924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e6e83-f48d-4632-86cb-addfea122bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:39:23.382508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6e83-f48d-4632-86cb-addfea122bc9 None admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:39:23.382787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6e83-f48d-4632-86cb-addfea122bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:39:23.383061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e6e83-f48d-4632-86cb-addfea122bc9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:39:23.383725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e6e83-f48d-4632-86cb-addfea122bc9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:39:23.385072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e6e83-f48d-4632-86cb-addfea122bc9 None admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:39:23.403939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 646/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:39:23 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:39:33.244039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=30 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:39:33.400222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:26.984918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f6f7-3274-4f3f-b91a-c84af984abee None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:26.985807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f6f7-3274-4f3f-b91a-c84af984abee None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:26.986291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f6f7-3274-4f3f-b91a-c84af984abee None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:26.990670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 661/1307] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:26.997114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e7dca-a977-4c90-8e40-42bc5572f8d0 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:26.997907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e7dca-a977-4c90-8e40-42bc5572f8d0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:26.997907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e7dca-a977-4c90-8e40-42bc5572f8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:27.101342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-158e7dca-a977-4c90-8e40-42bc5572f8d0 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:27.103266 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-158e7dca-a977-4c90-8e40-42bc5572f8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:27.241233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 647/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:27.545279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db4bf-bb39-4c22-8ef9-39dd5da94a0c None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:27.545623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db4bf-bb39-4c22-8ef9-39dd5da94a0c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:27.545905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98db4bf-bb39-4c22-8ef9-39dd5da94a0c None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:27.547400 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 662/1309] 10.222.0.16 () {54 vars in 963 bytes} [Sat Sep 17 00:40:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:27.553521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb7623-b6b4-4304-b4b7-4118c35d36b8 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:27.553810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb7623-b6b4-4304-b4b7-4118c35d36b8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:27.554084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb7623-b6b4-4304-b4b7-4118c35d36b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:27.634277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d7bb7623-b6b4-4304-b4b7-4118c35d36b8 None None] MFA Rules not processed for user `537d07153d3f4adfb3296c4e8e7084bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:27.635462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d7bb7623-b6b4-4304-b4b7-4118c35d36b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:27.657321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:27.716501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 648/1310] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Sep 17 00:40:27 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:27.725855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db4bf-bb39-4c22-8ef9-39dd5da94a0c None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:27.727596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b98db4bf-bb39-4c22-8ef9-39dd5da94a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:27.844705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98db4bf-bb39-4c22-8ef9-39dd5da94a0c None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:27.924146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d4f7a-1be9-47ab-8cc1-448b0e5e3e88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:27.924778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d4f7a-1be9-47ab-8cc1-448b0e5e3e88 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:27.925051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d4f7a-1be9-47ab-8cc1-448b0e5e3e88 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:27.925315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d4f7a-1be9-47ab-8cc1-448b0e5e3e88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:27.926969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c24d4f7a-1be9-47ab-8cc1-448b0e5e3e88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:27.984356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:28.060962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d4f7a-1be9-47ab-8cc1-448b0e5e3e88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:28.062486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d4f7a-1be9-47ab-8cc1-448b0e5e3e88 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:28.084138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 663/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:30.586520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f2e7-ee99-4c60-8bf8-080ebf406fe8 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:30.587111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f2e7-ee99-4c60-8bf8-080ebf406fe8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:30.587111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f5f2e7-ee99-4c60-8bf8-080ebf406fe8 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:30.588668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 649/1312] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:30.593987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ddf65-5eab-4a8e-b7ce-d71d6674cc35 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:30.594423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ddf65-5eab-4a8e-b7ce-d71d6674cc35 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:30.594656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10ddf65-5eab-4a8e-b7ce-d71d6674cc35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:30.676063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f10ddf65-5eab-4a8e-b7ce-d71d6674cc35 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:30.677279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f10ddf65-5eab-4a8e-b7ce-d71d6674cc35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:30.789218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 664/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:40:31.096045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52dd8-e8a1-41af-b0f8-ad747a09e7eb None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:31.096478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52dd8-e8a1-41af-b0f8-ad747a09e7eb None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:31.096703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c52dd8-e8a1-41af-b0f8-ad747a09e7eb None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:31.098526 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 650/1314] 10.222.0.16 () {54 vars in 963 bytes} [Sat Sep 17 00:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:31.105266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331669-deaa-4aa5-8762-47b97c828803 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:31.105587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331669-deaa-4aa5-8762-47b97c828803 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:31.105857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331669-deaa-4aa5-8762-47b97c828803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:31.117448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:31.180684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f7331669-deaa-4aa5-8762-47b97c828803 None None] MFA Rules not processed for user `537d07153d3f4adfb3296c4e8e7084bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:31.182068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f7331669-deaa-4aa5-8762-47b97c828803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:31.262166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 665/1315] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Sep 17 00:40:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:31.272152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c52dd8-e8a1-41af-b0f8-ad747a09e7eb None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:31.273706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-24c52dd8-e8a1-41af-b0f8-ad747a09e7eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:31.381851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c52dd8-e8a1-41af-b0f8-ad747a09e7eb None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:31.460118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:31.462618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fedeb1-f3d5-44a1-a6aa-cc08b94bec63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:31.463559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fedeb1-f3d5-44a1-a6aa-cc08b94bec63 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:31.464011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fedeb1-f3d5-44a1-a6aa-cc08b94bec63 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:31.464338 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fedeb1-f3d5-44a1-a6aa-cc08b94bec63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:31.466361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c7fedeb1-f3d5-44a1-a6aa-cc08b94bec63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:31.572847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fedeb1-f3d5-44a1-a6aa-cc08b94bec63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:31.574314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fedeb1-f3d5-44a1-a6aa-cc08b94bec63 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:31.592858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 651/1316] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:34.260522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59172726-d40d-49c0-9997-23e3f6e5f198 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:34.261038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59172726-d40d-49c0-9997-23e3f6e5f198 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:34.261143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59172726-d40d-49c0-9997-23e3f6e5f198 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:34.262501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 666/1317] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:34.267548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45888b-65d9-44ab-922b-6c76bcb02499 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:34.267957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45888b-65d9-44ab-922b-6c76bcb02499 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:34.268096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d45888b-65d9-44ab-922b-6c76bcb02499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:34.333166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-1d45888b-65d9-44ab-922b-6c76bcb02499 None None] MFA Rules not processed for user `62419e76eac94a61b44066fc9bade636`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:34.334375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1d45888b-65d9-44ab-922b-6c76bcb02499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:34.384445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:34.428950 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 652/1318] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:34.713118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59172726-d40d-49c0-9997-23e3f6e5f198 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:34.714930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-59172726-d40d-49c0-9997-23e3f6e5f198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:34.823401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59172726-d40d-49c0-9997-23e3f6e5f198 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:34.826188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:34.895296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5bca91-b4de-4529-8d42-ea0e38724ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:34.895898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bca91-b4de-4529-8d42-ea0e38724ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:34.896178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bca91-b4de-4529-8d42-ea0e38724ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:34.896454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5bca91-b4de-4529-8d42-ea0e38724ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:34.898062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-da5bca91-b4de-4529-8d42-ea0e38724ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:35.003536 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5bca91-b4de-4529-8d42-ea0e38724ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:35.004988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5bca91-b4de-4529-8d42-ea0e38724ce3 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:35.022313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 667/1319] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:34 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:37.658288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711710f6-9000-4513-aea1-40ae6d166c07 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:37.658821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711710f6-9000-4513-aea1-40ae6d166c07 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:37.658946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711710f6-9000-4513-aea1-40ae6d166c07 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:37.660795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 653/1320] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:37.666004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6266c2-32ff-4a32-a814-5130cf44d054 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:37.666495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6266c2-32ff-4a32-a814-5130cf44d054 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:37.666605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6266c2-32ff-4a32-a814-5130cf44d054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:37.705593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:37.731758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6b6266c2-32ff-4a32-a814-5130cf44d054 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:37.732963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6b6266c2-32ff-4a32-a814-5130cf44d054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:37.824892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 668/1321] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:38.106120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711710f6-9000-4513-aea1-40ae6d166c07 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:38.107635 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-711710f6-9000-4513-aea1-40ae6d166c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:38.208289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711710f6-9000-4513-aea1-40ae6d166c07 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:38.280887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f23174-e8b4-427b-a863-894b89f7aed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:38.281511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f23174-e8b4-427b-a863-894b89f7aed3 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:38.281788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f23174-e8b4-427b-a863-894b89f7aed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:38.282057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f23174-e8b4-427b-a863-894b89f7aed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:38.283601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e8f23174-e8b4-427b-a863-894b89f7aed3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:38.290278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:38.391030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f23174-e8b4-427b-a863-894b89f7aed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:38.392451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f23174-e8b4-427b-a863-894b89f7aed3 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:38.410459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 654/1322] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:41.734209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708c34b-477b-440c-b713-57376be2f556 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:41.734954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708c34b-477b-440c-b713-57376be2f556 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:41.734954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708c34b-477b-440c-b713-57376be2f556 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:41.735977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 669/1323] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:41.741391 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aa0ee-e674-4116-a0db-0665ab6cabb0 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:41.741859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aa0ee-e674-4116-a0db-0665ab6cabb0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:41.741955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14aa0ee-e674-4116-a0db-0665ab6cabb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:41.811351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d14aa0ee-e674-4116-a0db-0665ab6cabb0 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:41.812558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d14aa0ee-e674-4116-a0db-0665ab6cabb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:41.880520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:41.927633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 655/1324] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:42.212250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708c34b-477b-440c-b713-57376be2f556 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:42.214059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4708c34b-477b-440c-b713-57376be2f556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:42.324042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708c34b-477b-440c-b713-57376be2f556 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:42.339670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:42.403099 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb4234a-3c64-4563-94a8-d4194c7797bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:42.403711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4234a-3c64-4563-94a8-d4194c7797bb service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:42.403990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4234a-3c64-4563-94a8-d4194c7797bb service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:42.404264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb4234a-3c64-4563-94a8-d4194c7797bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:42.405879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-efb4234a-3c64-4563-94a8-d4194c7797bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:42.535419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4234a-3c64-4563-94a8-d4194c7797bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:42.536766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb4234a-3c64-4563-94a8-d4194c7797bb service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:42.558088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 670/1325] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:44.811440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3ce30-db3b-4a2b-af4d-8f1bb0f3d801 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:44.811998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3ce30-db3b-4a2b-af4d-8f1bb0f3d801 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:44.811998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af3ce30-db3b-4a2b-af4d-8f1bb0f3d801 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:44.813311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 656/1326] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:44.818488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb232696-ca77-4802-8143-e8c23a13f987 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:44.818914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb232696-ca77-4802-8143-e8c23a13f987 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:44.819046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb232696-ca77-4802-8143-e8c23a13f987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:44.866510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:44.885038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-fb232696-ca77-4802-8143-e8c23a13f987 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:44.886291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fb232696-ca77-4802-8143-e8c23a13f987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:45.003870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 671/1327] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:45.285525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3ce30-db3b-4a2b-af4d-8f1bb0f3d801 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:45.287046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4af3ce30-db3b-4a2b-af4d-8f1bb0f3d801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:45.395411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af3ce30-db3b-4a2b-af4d-8f1bb0f3d801 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:45.475280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd64796-5e6a-4d9c-a955-64ac27f7d18f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:45.475861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd64796-5e6a-4d9c-a955-64ac27f7d18f service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:45.476133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd64796-5e6a-4d9c-a955-64ac27f7d18f service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:45.476402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd64796-5e6a-4d9c-a955-64ac27f7d18f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:45.477997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ffd64796-5e6a-4d9c-a955-64ac27f7d18f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:45.495882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:45.595714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd64796-5e6a-4d9c-a955-64ac27f7d18f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:45.597132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd64796-5e6a-4d9c-a955-64ac27f7d18f service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:45.621957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 657/1328] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:47.831189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e169c-5c5d-431b-9f26-3350a30843be None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:47.831655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e169c-5c5d-431b-9f26-3350a30843be None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:47.831948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e169c-5c5d-431b-9f26-3350a30843be None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:47.833537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 672/1329] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:47.838700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0f108-1fd4-48b4-8f3a-13da97f153d5 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:47.839104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0f108-1fd4-48b4-8f3a-13da97f153d5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:47.839241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae0f108-1fd4-48b4-8f3a-13da97f153d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:47.903715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-fae0f108-1fd4-48b4-8f3a-13da97f153d5 None None] MFA Rules not processed for user `62419e76eac94a61b44066fc9bade636`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:47.904820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-fae0f108-1fd4-48b4-8f3a-13da97f153d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:47.968923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:48.001100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 658/1330] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:48.282039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e169c-5c5d-431b-9f26-3350a30843be None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:48.283543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e38e169c-5c5d-431b-9f26-3350a30843be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:48.388228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e169c-5c5d-431b-9f26-3350a30843be None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:48.408592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:48.468032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd67b8-0468-4e54-a5f8-8867f76586c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:48.468640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd67b8-0468-4e54-a5f8-8867f76586c4 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:48.468916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd67b8-0468-4e54-a5f8-8867f76586c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:48.469217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd67b8-0468-4e54-a5f8-8867f76586c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:48.470829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-95cd67b8-0468-4e54-a5f8-8867f76586c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:48.595250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd67b8-0468-4e54-a5f8-8867f76586c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:48.596703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cd67b8-0468-4e54-a5f8-8867f76586c4 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:48.620139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 673/1331] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:50.981870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770590e-0c89-40cb-aeef-a5bebbbb7f0c None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:50.982414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770590e-0c89-40cb-aeef-a5bebbbb7f0c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:50.982414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770590e-0c89-40cb-aeef-a5bebbbb7f0c None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:50.983746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 659/1332] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:50.989015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527de6c-ea77-4920-8352-2b972b041d12 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:50.989423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527de6c-ea77-4920-8352-2b972b041d12 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:50.989601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c527de6c-ea77-4920-8352-2b972b041d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:51.051545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:51.054238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c527de6c-ea77-4920-8352-2b972b041d12 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:51.055959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c527de6c-ea77-4920-8352-2b972b041d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:51.149119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 674/1333] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:51.426701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770590e-0c89-40cb-aeef-a5bebbbb7f0c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:51.428218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f770590e-0c89-40cb-aeef-a5bebbbb7f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:51.529003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770590e-0c89-40cb-aeef-a5bebbbb7f0c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:51.602118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdd1d2-633f-4538-a1fc-7014e7d29ffa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:51.602722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdd1d2-633f-4538-a1fc-7014e7d29ffa service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:51.603002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdd1d2-633f-4538-a1fc-7014e7d29ffa service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:51.603273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdd1d2-633f-4538-a1fc-7014e7d29ffa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:51.604842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-31bdd1d2-633f-4538-a1fc-7014e7d29ffa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:51.632752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:51.714129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdd1d2-633f-4538-a1fc-7014e7d29ffa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:51.715477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdd1d2-633f-4538-a1fc-7014e7d29ffa service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:51.732743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 660/1334] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:40:53.915669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b537fe8-67da-43f4-9901-ca00195392e0 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:53.916244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b537fe8-67da-43f4-9901-ca00195392e0 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:53.916244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b537fe8-67da-43f4-9901-ca00195392e0 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:53.917659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 675/1335] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:53.922855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188dd0-1599-4f73-8be6-3a75e9ce271f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:53.923256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188dd0-1599-4f73-8be6-3a75e9ce271f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:53.923400 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60188dd0-1599-4f73-8be6-3a75e9ce271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:53.987873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-60188dd0-1599-4f73-8be6-3a75e9ce271f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:53.988990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-60188dd0-1599-4f73-8be6-3a75e9ce271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:54.061295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:54.083624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 661/1336] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:40:54.371350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b537fe8-67da-43f4-9901-ca00195392e0 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:54.372881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0b537fe8-67da-43f4-9901-ca00195392e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:54.474696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b537fe8-67da-43f4-9901-ca00195392e0 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:54.502724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:54.546775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc7191-ddf0-457e-9d2d-f61cce3bcd22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:54.547378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc7191-ddf0-457e-9d2d-f61cce3bcd22 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:54.547654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc7191-ddf0-457e-9d2d-f61cce3bcd22 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:54.547925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc7191-ddf0-457e-9d2d-f61cce3bcd22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:54.549527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f6bc7191-ddf0-457e-9d2d-f61cce3bcd22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:54.667131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc7191-ddf0-457e-9d2d-f61cce3bcd22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:54.668472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc7191-ddf0-457e-9d2d-f61cce3bcd22 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:54.686317 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 676/1337] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:40:57.116565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2db88-403e-4e12-a615-5328760c05b8 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:57.117377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2db88-403e-4e12-a615-5328760c05b8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:57.117583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2db88-403e-4e12-a615-5328760c05b8 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:57.119049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 662/1338] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:40:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:40:57.124079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7480a-105d-425a-b7c9-08af7b8cbd7c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:57.124485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7480a-105d-425a-b7c9-08af7b8cbd7c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:57.124628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7480a-105d-425a-b7c9-08af7b8cbd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:57.187877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-65e7480a-105d-425a-b7c9-08af7b8cbd7c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:40:57.189064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-65e7480a-105d-425a-b7c9-08af7b8cbd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:57.198208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:57.286628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 677/1339] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:40:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:40:57.568720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2db88-403e-4e12-a615-5328760c05b8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:40:57.570276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-25c2db88-403e-4e12-a615-5328760c05b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:57.672250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2db88-403e-4e12-a615-5328760c05b8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:40:57.743866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9a15d9-dd84-47c9-8f60-651631ef240e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:40:57.744463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a15d9-dd84-47c9-8f60-651631ef240e service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:40:57.744740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a15d9-dd84-47c9-8f60-651631ef240e service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:40:57.745038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9a15d9-dd84-47c9-8f60-651631ef240e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:40:57.746662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8b9a15d9-dd84-47c9-8f60-651631ef240e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:40:57.781135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:40:57.853996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a15d9-dd84-47c9-8f60-651631ef240e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:40:57.855422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9a15d9-dd84-47c9-8f60-651631ef240e service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:40:57.873687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 663/1340] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:40:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:01.874102 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edae4a6-e809-49f2-83e0-05d81404ce06 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:01.874667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edae4a6-e809-49f2-83e0-05d81404ce06 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:01.874667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edae4a6-e809-49f2-83e0-05d81404ce06 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:01.876153 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 678/1341] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:01.881493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d399-c224-45ea-933d-00b46cfc247d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:01.882050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d399-c224-45ea-933d-00b46cfc247d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:01.882050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d399-c224-45ea-933d-00b46cfc247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:01.954513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-fd46d399-c224-45ea-933d-00b46cfc247d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:01.955653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-fd46d399-c224-45ea-933d-00b46cfc247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:02.058225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:02.071552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 664/1342] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:02.356730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edae4a6-e809-49f2-83e0-05d81404ce06 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:02.358292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0edae4a6-e809-49f2-83e0-05d81404ce06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:02.470274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edae4a6-e809-49f2-83e0-05d81404ce06 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:02.507535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:02.543041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b76158-b18e-4f53-a515-bdc60e47fa95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:02.543646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76158-b18e-4f53-a515-bdc60e47fa95 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:02.543923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76158-b18e-4f53-a515-bdc60e47fa95 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:02.544189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b76158-b18e-4f53-a515-bdc60e47fa95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:02.545777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-95b76158-b18e-4f53-a515-bdc60e47fa95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:02.653078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b76158-b18e-4f53-a515-bdc60e47fa95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:02.654449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b76158-b18e-4f53-a515-bdc60e47fa95 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:02.672543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 679/1343] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:05.450519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9542e6-234c-4109-bf4d-e5bc38a4856a None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:05.451107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9542e6-234c-4109-bf4d-e5bc38a4856a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:05.451107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9542e6-234c-4109-bf4d-e5bc38a4856a None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:05.452438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 665/1344] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:41:05.459013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946403-5f19-468a-8f29-68628129d2b7 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:05.459433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946403-5f19-468a-8f29-68628129d2b7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:05.459548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946403-5f19-468a-8f29-68628129d2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:05.525299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c8946403-5f19-468a-8f29-68628129d2b7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:05.526525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c8946403-5f19-468a-8f29-68628129d2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:05.544135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:05.625597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 680/1345] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:05.910912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9542e6-234c-4109-bf4d-e5bc38a4856a None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:05.912422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9f9542e6-234c-4109-bf4d-e5bc38a4856a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:06.020830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9542e6-234c-4109-bf4d-e5bc38a4856a None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:06.101116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26672c06-d19d-43c4-b8ff-b2439bcae3cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:06.101758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672c06-d19d-43c4-b8ff-b2439bcae3cc service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:06.102037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672c06-d19d-43c4-b8ff-b2439bcae3cc service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:06.102307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26672c06-d19d-43c4-b8ff-b2439bcae3cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:06.103916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-26672c06-d19d-43c4-b8ff-b2439bcae3cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:06.147037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:06.215794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26672c06-d19d-43c4-b8ff-b2439bcae3cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:06.217233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26672c06-d19d-43c4-b8ff-b2439bcae3cc service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:06.235687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 666/1346] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:10.280939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfd49f-4d41-410e-9b77-747efb656821 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:10.281478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfd49f-4d41-410e-9b77-747efb656821 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:10.281595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dfd49f-4d41-410e-9b77-747efb656821 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:10.287518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 681/1347] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:10.293045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc25a1f-3798-4b3b-9d57-1b24bff4f9c9 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:10.293615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc25a1f-3798-4b3b-9d57-1b24bff4f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:10.293727 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc25a1f-3798-4b3b-9d57-1b24bff4f9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:10.364260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3cc25a1f-3798-4b3b-9d57-1b24bff4f9c9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:10.365511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3cc25a1f-3798-4b3b-9d57-1b24bff4f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:10.477262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:10.477674 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 667/1348] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:41:10.781866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfd49f-4d41-410e-9b77-747efb656821 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:10.783376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-67dfd49f-4d41-410e-9b77-747efb656821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:10.894295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dfd49f-4d41-410e-9b77-747efb656821 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:10.941287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:10.966226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa811bb-310f-4e45-998f-4ff8427d2b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:10.966823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa811bb-310f-4e45-998f-4ff8427d2b85 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:10.967098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa811bb-310f-4e45-998f-4ff8427d2b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:10.967751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa811bb-310f-4e45-998f-4ff8427d2b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:10.969320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-dfa811bb-310f-4e45-998f-4ff8427d2b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:11.077161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa811bb-310f-4e45-998f-4ff8427d2b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:11.078562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa811bb-310f-4e45-998f-4ff8427d2b85 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:11.097025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 682/1349] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:15.980979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f083b4-2628-4aa9-a605-de4e97ab6ea4 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:15.980979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f083b4-2628-4aa9-a605-de4e97ab6ea4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:15.980979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f083b4-2628-4aa9-a605-de4e97ab6ea4 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:15.980979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 668/1350] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:15.987238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bb573-835f-42f6-a5a0-ec10e5a8ebca None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:15.987644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bb573-835f-42f6-a5a0-ec10e5a8ebca None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:15.989709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849bb573-835f-42f6-a5a0-ec10e5a8ebca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:16.110077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-849bb573-835f-42f6-a5a0-ec10e5a8ebca None None] MFA Rules not processed for user `47fef4612fbd4d00ad8de2a2144a2ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:16.112049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-849bb573-835f-42f6-a5a0-ec10e5a8ebca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:16.138595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:16.239822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 683/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:41:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:20.321048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9beb8-8b2c-48cf-acd5-ededfd54d95e None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:20.321621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9beb8-8b2c-48cf-acd5-ededfd54d95e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:20.321621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9beb8-8b2c-48cf-acd5-ededfd54d95e None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:20.323128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 669/1352] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:41:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:41:20.327971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbbf05-2028-46bd-b2de-2cd9ad9cc87c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:20.328420 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbbf05-2028-46bd-b2de-2cd9ad9cc87c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:20.328531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adbbf05-2028-46bd-b2de-2cd9ad9cc87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:20.410331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0adbbf05-2028-46bd-b2de-2cd9ad9cc87c None None] MFA Rules not processed for user `47fef4612fbd4d00ad8de2a2144a2ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:20.411524 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0adbbf05-2028-46bd-b2de-2cd9ad9cc87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:20.493236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:20.531566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 684/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:41:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:21.889575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682223-dc48-457e-9b68-05edcf304e56 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:21.890105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682223-dc48-457e-9b68-05edcf304e56 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:21.890232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca682223-dc48-457e-9b68-05edcf304e56 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:21.891688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 670/1354] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:41:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:21.896794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9729b1f-9f96-4c47-960a-1fd049415bf4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:21.897191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9729b1f-9f96-4c47-960a-1fd049415bf4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:21.897344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9729b1f-9f96-4c47-960a-1fd049415bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:21.974181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f9729b1f-9f96-4c47-960a-1fd049415bf4 None None] MFA Rules not processed for user `47fef4612fbd4d00ad8de2a2144a2ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:21.975380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f9729b1f-9f96-4c47-960a-1fd049415bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:22.081314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 685/1355] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:41:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:41:25.693993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbab112-d01f-428a-818c-f28a4064879f None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:25.694531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbab112-d01f-428a-818c-f28a4064879f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:25.694943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbab112-d01f-428a-818c-f28a4064879f None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:25.696858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 671/1356] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:25.703133 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39486b45-98fa-467d-863b-ecd7fe292fd7 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:25.703597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39486b45-98fa-467d-863b-ecd7fe292fd7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:25.703718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39486b45-98fa-467d-863b-ecd7fe292fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:25.742781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:25.778144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-39486b45-98fa-467d-863b-ecd7fe292fd7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:25.779337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-39486b45-98fa-467d-863b-ecd7fe292fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:25.885483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 686/1357] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:26.197766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77ca01-7f31-4361-a325-7dfddf204671 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:26.198466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77ca01-7f31-4361-a325-7dfddf204671 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:26.198953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77ca01-7f31-4361-a325-7dfddf204671 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:26.200959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 672/1358] 10.222.0.16 () {54 vars in 965 bytes} [Sat Sep 17 00:41:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:26.212869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054f13-8059-4c14-b52a-07524b0f475c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:26.213502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054f13-8059-4c14-b52a-07524b0f475c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:26.213814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c054f13-8059-4c14-b52a-07524b0f475c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:26.294680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7c054f13-8059-4c14-b52a-07524b0f475c None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:26.295874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7c054f13-8059-4c14-b52a-07524b0f475c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:26.349022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:26.432145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 687/1359] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Sep 17 00:41:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:26.433106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77ca01-7f31-4361-a325-7dfddf204671 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:26.434817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-eb77ca01-7f31-4361-a325-7dfddf204671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:26.594203 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77ca01-7f31-4361-a325-7dfddf204671 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:26.671385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:26.716999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6905e2a-fefb-4a0e-86a6-f5e5bcbf176d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:26.717843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6905e2a-fefb-4a0e-86a6-f5e5bcbf176d service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:26.718042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6905e2a-fefb-4a0e-86a6-f5e5bcbf176d service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:26.718318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6905e2a-fefb-4a0e-86a6-f5e5bcbf176d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:26.719904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a6905e2a-fefb-4a0e-86a6-f5e5bcbf176d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:26.822019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6905e2a-fefb-4a0e-86a6-f5e5bcbf176d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:26.824207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6905e2a-fefb-4a0e-86a6-f5e5bcbf176d service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:26.845183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 673/1360] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:29.236862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85152daa-dd2e-434c-99af-db82fb771d7f None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:29.236862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85152daa-dd2e-434c-99af-db82fb771d7f None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:29.237763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85152daa-dd2e-434c-99af-db82fb771d7f None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:29.244017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9c66a-a675-42fd-b693-3184ad4e740d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:29.244599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9c66a-a675-42fd-b693-3184ad4e740d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:29.244599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9c66a-a675-42fd-b693-3184ad4e740d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:29.248984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 688/1361] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:29 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:29.312999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-09e9c66a-a675-42fd-b693-3184ad4e740d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:29.314920 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-09e9c66a-a675-42fd-b693-3184ad4e740d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:29.353731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:29.422634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 674/1362] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:29.728140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85152daa-dd2e-434c-99af-db82fb771d7f None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:29.730313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-85152daa-dd2e-434c-99af-db82fb771d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:29.915928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85152daa-dd2e-434c-99af-db82fb771d7f None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:29.929340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:30.051885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51adf465-76c7-4dc8-b34a-d7eb8c2bceab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:30.052495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adf465-76c7-4dc8-b34a-d7eb8c2bceab service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:30.052764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adf465-76c7-4dc8-b34a-d7eb8c2bceab service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:30.053027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51adf465-76c7-4dc8-b34a-d7eb8c2bceab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:30.054655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-51adf465-76c7-4dc8-b34a-d7eb8c2bceab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:30.147301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adf465-76c7-4dc8-b34a-d7eb8c2bceab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:30.149041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51adf465-76c7-4dc8-b34a-d7eb8c2bceab service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:30.167765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 689/1363] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:32.686848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32768a8-acdf-4d44-802d-d716f296fcb0 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:32.687451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32768a8-acdf-4d44-802d-d716f296fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:32.687451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32768a8-acdf-4d44-802d-d716f296fcb0 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:32.688751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 675/1364] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:32.694720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4dbda-76ca-49b6-ba21-66fb18d4c119 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:32.695147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4dbda-76ca-49b6-ba21-66fb18d4c119 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:32.695339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4dbda-76ca-49b6-ba21-66fb18d4c119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:32.711521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:32.770722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-5fe4dbda-76ca-49b6-ba21-66fb18d4c119 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:32.772203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5fe4dbda-76ca-49b6-ba21-66fb18d4c119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:32.880950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 690/1365] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:33.176199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b20d-5539-4c4b-ba1e-40f1d5c6dfb7 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:33.176485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b20d-5539-4c4b-ba1e-40f1d5c6dfb7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:33.176957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308b20d-5539-4c4b-ba1e-40f1d5c6dfb7 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:33.178339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 676/1366] 10.222.0.16 () {54 vars in 965 bytes} [Sat Sep 17 00:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:33.184076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6f004-bc97-4d11-85a4-a28a91f169a4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:33.184372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6f004-bc97-4d11-85a4-a28a91f169a4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:33.184656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf6f004-bc97-4d11-85a4-a28a91f169a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:33.263782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3bf6f004-bc97-4d11-85a4-a28a91f169a4 None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:33.265003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3bf6f004-bc97-4d11-85a4-a28a91f169a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:33.301919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:33.391619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 691/1367] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Sep 17 00:41:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:33.402337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308b20d-5539-4c4b-ba1e-40f1d5c6dfb7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:33.403871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2308b20d-5539-4c4b-ba1e-40f1d5c6dfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:33.566735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308b20d-5539-4c4b-ba1e-40f1d5c6dfb7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:33.587960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:33.686789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f15bb-c732-4bff-aa60-8b66954d6c5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:33.687317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f15bb-c732-4bff-aa60-8b66954d6c5f service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:33.687888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f15bb-c732-4bff-aa60-8b66954d6c5f service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:33.687888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f15bb-c732-4bff-aa60-8b66954d6c5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:33.689551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4b4f15bb-c732-4bff-aa60-8b66954d6c5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:33.791841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f15bb-c732-4bff-aa60-8b66954d6c5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:33.793901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4f15bb-c732-4bff-aa60-8b66954d6c5f service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:33.816166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 677/1368] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:33.878756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f2001-bf0e-415a-991c-313f4bbadbd7 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:33.879243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f2001-bf0e-415a-991c-313f4bbadbd7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:33.879243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3f2001-bf0e-415a-991c-313f4bbadbd7 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:33.880630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 692/1369] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:33.885840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69654b-a5ea-46df-8e12-a1429ce0b8cd None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:33.887139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69654b-a5ea-46df-8e12-a1429ce0b8cd None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:33.887570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f69654b-a5ea-46df-8e12-a1429ce0b8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:33.924031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:33.971200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2f69654b-a5ea-46df-8e12-a1429ce0b8cd None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:33.972577 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2f69654b-a5ea-46df-8e12-a1429ce0b8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:34.089725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 678/1370] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:34.430540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e8520-1746-41e2-a61f-3d203d8e2927 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:34.430540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e8520-1746-41e2-a61f-3d203d8e2927 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:34.430540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06e8520-1746-41e2-a61f-3d203d8e2927 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:34.434424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 693/1371] 10.222.0.16 () {54 vars in 964 bytes} [Sat Sep 17 00:41:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:34.435125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce812ddf-836e-46cf-98b8-b410dce3c82a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:34.435125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce812ddf-836e-46cf-98b8-b410dce3c82a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:34.435434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce812ddf-836e-46cf-98b8-b410dce3c82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:34.519807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ce812ddf-836e-46cf-98b8-b410dce3c82a None None] MFA Rules not processed for user `29e517f2741c4f14877ba49d5be2229a`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:34.521036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ce812ddf-836e-46cf-98b8-b410dce3c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:34.569868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:34.602996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 679/1372] 10.222.0.16 () {58 vars in 1061 bytes} [Sat Sep 17 00:41:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:34.610596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e8520-1746-41e2-a61f-3d203d8e2927 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:34.612923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e06e8520-1746-41e2-a61f-3d203d8e2927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:34.725378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06e8520-1746-41e2-a61f-3d203d8e2927 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:34.768618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:34.806744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38c34e-ca31-40c0-bc7a-40a36f38662b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:34.807362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38c34e-ca31-40c0-bc7a-40a36f38662b service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:34.807628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38c34e-ca31-40c0-bc7a-40a36f38662b service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:34.807894 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38c34e-ca31-40c0-bc7a-40a36f38662b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:34.809482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0c38c34e-ca31-40c0-bc7a-40a36f38662b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:34.937976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38c34e-ca31-40c0-bc7a-40a36f38662b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:34.939828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38c34e-ca31-40c0-bc7a-40a36f38662b service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:34.961363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 694/1373] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:36.056045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbe1ff-ab30-454d-849f-4a0b2cc75d65 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:36.056587 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbe1ff-ab30-454d-849f-4a0b2cc75d65 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:36.056679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bbe1ff-ab30-454d-849f-4a0b2cc75d65 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:36.058003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 680/1374] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:41:36.063612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33605a-5d51-410c-b512-3bf3a0136602 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:36.064426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33605a-5d51-410c-b512-3bf3a0136602 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:36.064722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad33605a-5d51-410c-b512-3bf3a0136602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:36.129896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ad33605a-5d51-410c-b512-3bf3a0136602 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:36.131110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ad33605a-5d51-410c-b512-3bf3a0136602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:36.151759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:36.230117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 695/1375] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:36.524401 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbe1ff-ab30-454d-849f-4a0b2cc75d65 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:36.525976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-03bbe1ff-ab30-454d-849f-4a0b2cc75d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:36.681227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bbe1ff-ab30-454d-849f-4a0b2cc75d65 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:36.742935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:36.806018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625062b3-8b4c-48eb-b75d-5fc5bc7f486c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:36.806627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625062b3-8b4c-48eb-b75d-5fc5bc7f486c service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:36.806902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625062b3-8b4c-48eb-b75d-5fc5bc7f486c service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:36.807169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625062b3-8b4c-48eb-b75d-5fc5bc7f486c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:36.808739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-625062b3-8b4c-48eb-b75d-5fc5bc7f486c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:36.903811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625062b3-8b4c-48eb-b75d-5fc5bc7f486c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:36.905443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625062b3-8b4c-48eb-b75d-5fc5bc7f486c service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:36.924229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 681/1376] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:39.147365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1adf8d-ddd5-4033-9083-3cb673390784 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:39.147923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1adf8d-ddd5-4033-9083-3cb673390784 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:39.147923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1adf8d-ddd5-4033-9083-3cb673390784 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:39.149503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 696/1377] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:39.154561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c3674-5131-45db-80a3-2ffb6082f150 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:39.155019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c3674-5131-45db-80a3-2ffb6082f150 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:39.155102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82c3674-5131-45db-80a3-2ffb6082f150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:39.224877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-c82c3674-5131-45db-80a3-2ffb6082f150 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:39.226126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c82c3674-5131-45db-80a3-2ffb6082f150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:39.234161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:39.332343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 682/1378] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:39.625692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1adf8d-ddd5-4033-9083-3cb673390784 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:39.627343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1e1adf8d-ddd5-4033-9083-3cb673390784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:39.781381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1adf8d-ddd5-4033-9083-3cb673390784 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:39.785532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:39.900470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6463d4-9f1d-43ec-8f11-bf8dc92a4e75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:39.901248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6463d4-9f1d-43ec-8f11-bf8dc92a4e75 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:39.901671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6463d4-9f1d-43ec-8f11-bf8dc92a4e75 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:39.902083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6463d4-9f1d-43ec-8f11-bf8dc92a4e75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:39.903749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0a6463d4-9f1d-43ec-8f11-bf8dc92a4e75 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:40.000323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6463d4-9f1d-43ec-8f11-bf8dc92a4e75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:40.002687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6463d4-9f1d-43ec-8f11-bf8dc92a4e75 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:40.025463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 697/1379] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:42.231659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49f92-f21a-4bff-8dcf-296ddf41a1e8 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:42.232202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49f92-f21a-4bff-8dcf-296ddf41a1e8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:42.232202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb49f92-f21a-4bff-8dcf-296ddf41a1e8 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:42.233729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 683/1380] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:42.239521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901d2e6-eed0-418b-bc44-bc0d3c3546df None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:42.239918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901d2e6-eed0-418b-bc44-bc0d3c3546df None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:42.240075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e901d2e6-eed0-418b-bc44-bc0d3c3546df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:42.252008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:42.311108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e901d2e6-eed0-418b-bc44-bc0d3c3546df None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:42.312896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e901d2e6-eed0-418b-bc44-bc0d3c3546df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:42.468475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 698/1381] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:42.754561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49f92-f21a-4bff-8dcf-296ddf41a1e8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:42.756113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-dbb49f92-f21a-4bff-8dcf-296ddf41a1e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:42.904083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:42.915014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb49f92-f21a-4bff-8dcf-296ddf41a1e8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:43.031104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6c8c1-98f3-4ed9-9375-24c4f48182a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:43.031835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6c8c1-98f3-4ed9-9375-24c4f48182a7 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:43.032104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6c8c1-98f3-4ed9-9375-24c4f48182a7 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:43.032857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6c8c1-98f3-4ed9-9375-24c4f48182a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:43.034590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-04a6c8c1-98f3-4ed9-9375-24c4f48182a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:43.126869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6c8c1-98f3-4ed9-9375-24c4f48182a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:43.128184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6c8c1-98f3-4ed9-9375-24c4f48182a7 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:43.138475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:43.147458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 684/1382] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:45.353570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f383a5b-68c0-453f-9abe-7a1ccf53d460 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:45.354268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f383a5b-68c0-453f-9abe-7a1ccf53d460 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:45.354268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f383a5b-68c0-453f-9abe-7a1ccf53d460 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:45.355473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 699/1383] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:41:45.360884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ac95-f350-409d-b9d7-5016e8911fc7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:45.361444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ac95-f350-409d-b9d7-5016e8911fc7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:45.361558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9ac95-f350-409d-b9d7-5016e8911fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:45.431448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-70e9ac95-f350-409d-b9d7-5016e8911fc7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:45.432658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-70e9ac95-f350-409d-b9d7-5016e8911fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:45.530981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 685/1384] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:41:45.826891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f383a5b-68c0-453f-9abe-7a1ccf53d460 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:45.828460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4f383a5b-68c0-453f-9abe-7a1ccf53d460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:45.915285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:45.978227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f383a5b-68c0-453f-9abe-7a1ccf53d460 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:46.099947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aad9f0-2041-4f04-9e56-35127d732356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:46.100531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad9f0-2041-4f04-9e56-35127d732356 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:46.100860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad9f0-2041-4f04-9e56-35127d732356 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:46.101083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aad9f0-2041-4f04-9e56-35127d732356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:46.102781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e1aad9f0-2041-4f04-9e56-35127d732356 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:46.155733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:46.197380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aad9f0-2041-4f04-9e56-35127d732356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:46.199191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1aad9f0-2041-4f04-9e56-35127d732356 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:46.217487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 700/1385] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:48.626800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ace6-5872-455c-b98d-39b306a959a6 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:48.627565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ace6-5872-455c-b98d-39b306a959a6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:48.627565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5ace6-5872-455c-b98d-39b306a959a6 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:48.628668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 686/1386] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:48.634051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5efb27-cfd4-4a25-b86a-069762e8ca10 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:48.634463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5efb27-cfd4-4a25-b86a-069762e8ca10 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:48.634541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5efb27-cfd4-4a25-b86a-069762e8ca10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:48.705632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8b5efb27-cfd4-4a25-b86a-069762e8ca10 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:48.706837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8b5efb27-cfd4-4a25-b86a-069762e8ca10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:48.803394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 701/1387] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:49.096104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ace6-5872-455c-b98d-39b306a959a6 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:49.097667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-90c5ace6-5872-455c-b98d-39b306a959a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:49.174134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:49.246063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5ace6-5872-455c-b98d-39b306a959a6 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:49.357252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ca52e1-a292-4825-8836-3006f5daa028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:49.357798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca52e1-a292-4825-8836-3006f5daa028 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:49.358074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca52e1-a292-4825-8836-3006f5daa028 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:49.358343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ca52e1-a292-4825-8836-3006f5daa028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:49.359942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-14ca52e1-a292-4825-8836-3006f5daa028 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:49.398206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:49.450048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca52e1-a292-4825-8836-3006f5daa028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:49.451651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ca52e1-a292-4825-8836-3006f5daa028 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:49.469660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 687/1388] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:50.486128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e859a9-dd4d-4929-b365-5dd2c7e7b799 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:50.486653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e859a9-dd4d-4929-b365-5dd2c7e7b799 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:50.486653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e859a9-dd4d-4929-b365-5dd2c7e7b799 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:50.488296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 702/1389] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:50.493713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e40b2e-0e95-4e24-82d1-1177c30d1927 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:50.494153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e40b2e-0e95-4e24-82d1-1177c30d1927 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:50.494153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e40b2e-0e95-4e24-82d1-1177c30d1927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:50.564566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-88e40b2e-0e95-4e24-82d1-1177c30d1927 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:50.565802 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-88e40b2e-0e95-4e24-82d1-1177c30d1927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:50.674585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 688/1390] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:50.976055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b978f-dd9b-4f52-adf1-d0d49ee94f3e None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:50.976329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b978f-dd9b-4f52-adf1-d0d49ee94f3e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:50.976611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2b978f-dd9b-4f52-adf1-d0d49ee94f3e None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:50.977952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 703/1391] 10.222.0.16 () {54 vars in 962 bytes} [Sat Sep 17 00:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:50.983089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3bc16-b352-4573-9ac0-f0a7df09004f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:50.983378 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3bc16-b352-4573-9ac0-f0a7df09004f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:50.983658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3bc16-b352-4573-9ac0-f0a7df09004f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:50.999887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:51.064961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0cd3bc16-b352-4573-9ac0-f0a7df09004f None None] MFA Rules not processed for user `babdd851ad7b4ba99b5746d8480bc082`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:51.066193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0cd3bc16-b352-4573-9ac0-f0a7df09004f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:51.141037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 689/1392] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Sep 17 00:41:50 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:41:51.150640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b978f-dd9b-4f52-adf1-d0d49ee94f3e None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:51.152216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ac2b978f-dd9b-4f52-adf1-d0d49ee94f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:51.183202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:51.257050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2b978f-dd9b-4f52-adf1-d0d49ee94f3e None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:51.335692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f9cf8-3e33-4d61-b27c-d5fe74f127de service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babdd851ad7b4ba99b5746d8480bc082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:51.336303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9cf8-3e33-4d61-b27c-d5fe74f127de service glance] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:51.336579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9cf8-3e33-4d61-b27c-d5fe74f127de service glance] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:51.336848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f9cf8-3e33-4d61-b27c-d5fe74f127de service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:51.338712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-719f9cf8-3e33-4d61-b27c-d5fe74f127de service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:51.418385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:51.451123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9cf8-3e33-4d61-b27c-d5fe74f127de service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:51.452563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f9cf8-3e33-4d61-b27c-d5fe74f127de service glance] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:51.472328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 704/1393] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:51.659355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3bb68-48c6-43c6-9ab5-648dd0853333 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:51.659913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3bb68-48c6-43c6-9ab5-648dd0853333 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:51.659913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3bb68-48c6-43c6-9ab5-648dd0853333 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:51.661501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 690/1394] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:51.667447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade340c-456b-4174-94c8-f6706fac6f23 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:51.667980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade340c-456b-4174-94c8-f6706fac6f23 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:51.668303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ade340c-456b-4174-94c8-f6706fac6f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:51.743366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0ade340c-456b-4174-94c8-f6706fac6f23 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:51.744574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0ade340c-456b-4174-94c8-f6706fac6f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:51.849842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 705/1395] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:52.140792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3bb68-48c6-43c6-9ab5-648dd0853333 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:52.142916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d0b3bb68-48c6-43c6-9ab5-648dd0853333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:52.205040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e29dd-38e0-4fd3-9223-3474c5a94c9a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:52.205397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e29dd-38e0-4fd3-9223-3474c5a94c9a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:52.205769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5e29dd-38e0-4fd3-9223-3474c5a94c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:52.247451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:52.251954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:52.274452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2f5e29dd-38e0-4fd3-9223-3474c5a94c9a None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:52.275660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2f5e29dd-38e0-4fd3-9223-3474c5a94c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:52.295854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3bb68-48c6-43c6-9ab5-648dd0853333 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:52.365066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 706/1396] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:41:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:52.409224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fec0f1-2614-4f95-bd4b-260b77db9ddc None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:52.409915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fec0f1-2614-4f95-bd4b-260b77db9ddc None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:52.410193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fec0f1-2614-4f95-bd4b-260b77db9ddc None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:52.411539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 707/1397] 10.222.0.16 () {54 vars in 943 bytes} [Sat Sep 17 00:41:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:41:52.419012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc4dd-88e9-489d-a393-432e837404e8 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:52.419012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc4dd-88e9-489d-a393-432e837404e8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:52.419249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92fc4dd-88e9-489d-a393-432e837404e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:52.420890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:52.421551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:52.421834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:52.422111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:52.423849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:52.495420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:52.498453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b92fc4dd-88e9-489d-a393-432e837404e8 None None] MFA Rules not processed for user `6247f16e4bf6497183e40a7ed31ff23c`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:52.499680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b92fc4dd-88e9-489d-a393-432e837404e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:52.516773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:52.518435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:52.536648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 691/1398] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:52.564638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:52.623539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 708/1399] 10.222.0.16 () {58 vars in 1040 bytes} [Sat Sep 17 00:41:52 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:41:52.634389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:52.635636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:52.729816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a0b19-7a39-4b2e-ba51-aad1bda66bed service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:52.836660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:52.838700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7437f0-e812-4036-8f1f-db31b1c8c4df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:52.839408 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7437f0-e812-4036-8f1f-db31b1c8c4df service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:52.839699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7437f0-e812-4036-8f1f-db31b1c8c4df service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:52.840159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7437f0-e812-4036-8f1f-db31b1c8c4df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:52.842336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-cd7437f0-e812-4036-8f1f-db31b1c8c4df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:52.925281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7437f0-e812-4036-8f1f-db31b1c8c4df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:52.927109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7437f0-e812-4036-8f1f-db31b1c8c4df service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:52.937566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 692/1400] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:41:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:41:54.717273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1fe0-f932-4c1d-91f5-002f10c1edc7 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:54.717874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1fe0-f932-4c1d-91f5-002f10c1edc7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:54.717874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1e1fe0-f932-4c1d-91f5-002f10c1edc7 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:54.719243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 709/1401] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:54.725054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f0db-d0cd-44ef-b454-d7c515b173bf None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:54.725863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f0db-d0cd-44ef-b454-d7c515b173bf None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:54.726139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555f0db-d0cd-44ef-b454-d7c515b173bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:54.799840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a555f0db-d0cd-44ef-b454-d7c515b173bf None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:54.801047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a555f0db-d0cd-44ef-b454-d7c515b173bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:54.904410 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:54.912130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 693/1402] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:41:55.216696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e1fe0-f932-4c1d-91f5-002f10c1edc7 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:55.218312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8f1e1fe0-f932-4c1d-91f5-002f10c1edc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:55.382352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1e1fe0-f932-4c1d-91f5-002f10c1edc7 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:55.432230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:55.515503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e477e13-c61f-484f-a8bc-bfae8e323ef1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:55.516120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e477e13-c61f-484f-a8bc-bfae8e323ef1 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:55.517044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e477e13-c61f-484f-a8bc-bfae8e323ef1 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:55.517324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e477e13-c61f-484f-a8bc-bfae8e323ef1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:55.519049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7e477e13-c61f-484f-a8bc-bfae8e323ef1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:55.615783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e477e13-c61f-484f-a8bc-bfae8e323ef1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:55.617703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e477e13-c61f-484f-a8bc-bfae8e323ef1 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:55.638838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 710/1403] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:41:57.868557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0f22-bc3e-4197-a395-258224c30208 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:57.868557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0f22-bc3e-4197-a395-258224c30208 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:57.868557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cc0f22-bc3e-4197-a395-258224c30208 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:57.873597 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 694/1404] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:41:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:41:57.875645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bbe1-0873-4f0a-a365-b0f946f7bf39 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:57.876067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bbe1-0873-4f0a-a365-b0f946f7bf39 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:57.876350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d30bbe1-0873-4f0a-a365-b0f946f7bf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:57.938493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:57.947260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2d30bbe1-0873-4f0a-a365-b0f946f7bf39 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:41:57.948488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2d30bbe1-0873-4f0a-a365-b0f946f7bf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:58.060210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 711/1405] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:41:58.359679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0f22-bc3e-4197-a395-258224c30208 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:41:58.361307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-11cc0f22-bc3e-4197-a395-258224c30208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:58.548296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cc0f22-bc3e-4197-a395-258224c30208 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:41:58.633009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:41:58.686424 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf8eb7-2f47-4181-8454-8ec50f3be752 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:41:58.687042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf8eb7-2f47-4181-8454-8ec50f3be752 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:41:58.687323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf8eb7-2f47-4181-8454-8ec50f3be752 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:41:58.687600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf8eb7-2f47-4181-8454-8ec50f3be752 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:41:58.689349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ffbf8eb7-2f47-4181-8454-8ec50f3be752 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:41:58.788201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf8eb7-2f47-4181-8454-8ec50f3be752 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:41:58.789845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf8eb7-2f47-4181-8454-8ec50f3be752 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:41:58.809840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 695/1406] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:01.054033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b739a-8e59-4f93-b558-d8ec9c780118 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:01.054579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b739a-8e59-4f93-b558-d8ec9c780118 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:01.054579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b739a-8e59-4f93-b558-d8ec9c780118 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:01.056318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 712/1407] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:42:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:01.061166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67771eb4-b855-4c57-9913-dd128d4862c4 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:01.061639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67771eb4-b855-4c57-9913-dd128d4862c4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:01.061745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67771eb4-b855-4c57-9913-dd128d4862c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:01.129104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-67771eb4-b855-4c57-9913-dd128d4862c4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:01.130340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-67771eb4-b855-4c57-9913-dd128d4862c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:01.162247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:01.233267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 696/1408] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:01.527207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b739a-8e59-4f93-b558-d8ec9c780118 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:01.528762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b12b739a-8e59-4f93-b558-d8ec9c780118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:01.660184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:01.690598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b739a-8e59-4f93-b558-d8ec9c780118 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:01.831953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b370b56-6850-4b59-8c24-f46190fc18e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:01.832604 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b370b56-6850-4b59-8c24-f46190fc18e8 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:01.832882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b370b56-6850-4b59-8c24-f46190fc18e8 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:01.833154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b370b56-6850-4b59-8c24-f46190fc18e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:01.834784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5b370b56-6850-4b59-8c24-f46190fc18e8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:01.928253 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:01.931698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b370b56-6850-4b59-8c24-f46190fc18e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:01.933942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b370b56-6850-4b59-8c24-f46190fc18e8 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:01.954052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 713/1409] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:11.231471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=30 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:11.953988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=7 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:15.877841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6f2b1-1faf-46f4-b855-bf0bd8a3e5e4 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:15.878442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6f2b1-1faf-46f4-b855-bf0bd8a3e5e4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:15.878442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b6f2b1-1faf-46f4-b855-bf0bd8a3e5e4 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:15.879781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 697/1410] 10.222.0.16 () {54 vars in 918 bytes} [Sat Sep 17 00:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:15.884734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1d31e-e98e-44af-b69f-632a7ecc0fad None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:15.885165 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1d31e-e98e-44af-b69f-632a7ecc0fad None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:15.885284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1d31e-e98e-44af-b69f-632a7ecc0fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:15.961433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-72d1d31e-e98e-44af-b69f-632a7ecc0fad None None] MFA Rules not processed for user `47fef4612fbd4d00ad8de2a2144a2ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:15.962679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-72d1d31e-e98e-44af-b69f-632a7ecc0fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:16.081663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 714/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Sep 17 00:42:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:16.097215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5705f2-7aba-40ad-aef6-643c0ee4c345 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:16.097734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5705f2-7aba-40ad-aef6-643c0ee4c345 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:16.098012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5705f2-7aba-40ad-aef6-643c0ee4c345 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:16.099368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 698/1412] 10.222.0.16 () {54 vars in 918 bytes} [Sat Sep 17 00:42:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:42:16.104402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b476c-20d5-4664-b7d1-b977cbdf39ea None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:16.104686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b476c-20d5-4664-b7d1-b977cbdf39ea None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:16.104957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847b476c-20d5-4664-b7d1-b977cbdf39ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:16.176958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:16.180071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-847b476c-20d5-4664-b7d1-b977cbdf39ea None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:16.181850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-847b476c-20d5-4664-b7d1-b977cbdf39ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:16.296374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 715/1413] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Sep 17 00:42:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:18.913705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b65262-1bab-43f5-9e2f-4495e6bbad11 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:18.914272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b65262-1bab-43f5-9e2f-4495e6bbad11 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:18.914272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b65262-1bab-43f5-9e2f-4495e6bbad11 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:18.915595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 699/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:18.920940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718375-8b71-41c1-82d0-99b070e260ee None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:18.921362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718375-8b71-41c1-82d0-99b070e260ee None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:18.921567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718375-8b71-41c1-82d0-99b070e260ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:18.994865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3e718375-8b71-41c1-82d0-99b070e260ee None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:18.996082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3e718375-8b71-41c1-82d0-99b070e260ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:19.055466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:19.099071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 716/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:19.393170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b65262-1bab-43f5-9e2f-4495e6bbad11 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:19.394902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-80b65262-1bab-43f5-9e2f-4495e6bbad11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:19.538249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b65262-1bab-43f5-9e2f-4495e6bbad11 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:19.611665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:19.653591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d76a19-e970-4e5f-9047-f4a41f09a837 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:19.654122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d76a19-e970-4e5f-9047-f4a41f09a837 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:19.654401 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d76a19-e970-4e5f-9047-f4a41f09a837 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:19.654675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d76a19-e970-4e5f-9047-f4a41f09a837 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:19.656888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d1d76a19-e970-4e5f-9047-f4a41f09a837 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:19.744646 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d76a19-e970-4e5f-9047-f4a41f09a837 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:19.746283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d76a19-e970-4e5f-9047-f4a41f09a837 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:19.764240 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 700/1416] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:42:20.889309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7badd-3075-4c37-8ccf-9b9631d38c64 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:20.889927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7badd-3075-4c37-8ccf-9b9631d38c64 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:20.889927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef7badd-3075-4c37-8ccf-9b9631d38c64 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:20.891764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 717/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:20.897985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad877a87-496c-4229-ab40-660c4cf7ba36 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:20.898413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad877a87-496c-4229-ab40-660c4cf7ba36 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:20.898563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad877a87-496c-4229-ab40-660c4cf7ba36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:20.973907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ad877a87-496c-4229-ab40-660c4cf7ba36 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:20.975104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ad877a87-496c-4229-ab40-660c4cf7ba36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:21.001746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:21.071062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 701/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:21.219804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7badd-3075-4c37-8ccf-9b9631d38c64 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:21.221296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4ef7badd-3075-4c37-8ccf-9b9631d38c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:21.362262 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef7badd-3075-4c37-8ccf-9b9631d38c64 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:21.402335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:21.473340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675feb55-e0e1-457f-8bdf-c9edd77e2022 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:21.473896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675feb55-e0e1-457f-8bdf-c9edd77e2022 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:21.474170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675feb55-e0e1-457f-8bdf-c9edd77e2022 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:21.474435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675feb55-e0e1-457f-8bdf-c9edd77e2022 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:21.475995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-675feb55-e0e1-457f-8bdf-c9edd77e2022 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:21.563266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675feb55-e0e1-457f-8bdf-c9edd77e2022 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:21.564849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675feb55-e0e1-457f-8bdf-c9edd77e2022 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:21.582861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 718/1419] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:22.709472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b549d8-f6b3-437b-a959-75d37607da53 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:22.710005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b549d8-f6b3-437b-a959-75d37607da53 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:22.710005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b549d8-f6b3-437b-a959-75d37607da53 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:22.711357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 702/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:22.717884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715236b-ee2c-4826-b4b6-1963b46d8255 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:22.718326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715236b-ee2c-4826-b4b6-1963b46d8255 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:22.718446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715236b-ee2c-4826-b4b6-1963b46d8255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:22.771763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:22.793893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c715236b-ee2c-4826-b4b6-1963b46d8255 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:22.795098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c715236b-ee2c-4826-b4b6-1963b46d8255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:22.889849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 719/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:23.041428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b549d8-f6b3-437b-a959-75d37607da53 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:23.043233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f4b549d8-f6b3-437b-a959-75d37607da53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:23.185681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b549d8-f6b3-437b-a959-75d37607da53 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:23.197324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:23.301655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd45cc9-7d8a-46e1-bf0e-519a22e21cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:23.302172 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45cc9-7d8a-46e1-bf0e-519a22e21cdd service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:23.302446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45cc9-7d8a-46e1-bf0e-519a22e21cdd service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:23.302712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd45cc9-7d8a-46e1-bf0e-519a22e21cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:23.304292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-cfd45cc9-7d8a-46e1-bf0e-519a22e21cdd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:23.391019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45cc9-7d8a-46e1-bf0e-519a22e21cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:23.392596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd45cc9-7d8a-46e1-bf0e-519a22e21cdd service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:23.410250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 703/1422] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:24.524013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33a2c3-1e61-4089-b7de-fd7fbc2f6b92 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:24.524550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33a2c3-1e61-4089-b7de-fd7fbc2f6b92 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:24.524550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33a2c3-1e61-4089-b7de-fd7fbc2f6b92 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:24.525963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 720/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:24.532864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac9526-028e-4ee0-9643-d0c1a5b4d4d3 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:24.533274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac9526-028e-4ee0-9643-d0c1a5b4d4d3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:24.533388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ac9526-028e-4ee0-9643-d0c1a5b4d4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:24.553411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:24.607487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-86ac9526-028e-4ee0-9643-d0c1a5b4d4d3 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:24.608660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-86ac9526-028e-4ee0-9643-d0c1a5b4d4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:24.702046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 704/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:24.854015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33a2c3-1e61-4089-b7de-fd7fbc2f6b92 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:24.855424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1b33a2c3-1e61-4089-b7de-fd7fbc2f6b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:24.964630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:25.002163 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33a2c3-1e61-4089-b7de-fd7fbc2f6b92 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:25.113516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5550343-b216-4e18-8d88-01cbb0d9c4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:25.114051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5550343-b216-4e18-8d88-01cbb0d9c4e9 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:25.114327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5550343-b216-4e18-8d88-01cbb0d9c4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:25.114596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5550343-b216-4e18-8d88-01cbb0d9c4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:25.116151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a5550343-b216-4e18-8d88-01cbb0d9c4e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:25.190748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:25.204969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5550343-b216-4e18-8d88-01cbb0d9c4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:25.206597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5550343-b216-4e18-8d88-01cbb0d9c4e9 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:25.224608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 721/1425] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:26.326673 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c991-8e90-4ad3-8737-6abaff4296cd None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:26.327305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c991-8e90-4ad3-8737-6abaff4296cd None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:26.327305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c991-8e90-4ad3-8737-6abaff4296cd None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:26.328665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 705/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:26.334967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d9e5-621b-40b2-b66d-5b5ab954e870 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:26.335413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d9e5-621b-40b2-b66d-5b5ab954e870 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:26.335525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f7d9e5-621b-40b2-b66d-5b5ab954e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:26.412445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d8f7d9e5-621b-40b2-b66d-5b5ab954e870 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:26.413610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d8f7d9e5-621b-40b2-b66d-5b5ab954e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:26.625853 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 722/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:26.775479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8c991-8e90-4ad3-8737-6abaff4296cd None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:26.777022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1cc8c991-8e90-4ad3-8737-6abaff4296cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:26.859758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:26.921851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8c991-8e90-4ad3-8737-6abaff4296cd None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:27.033468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40590ed8-2502-48fc-ae3d-ffc71cd5ee66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:27.034120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40590ed8-2502-48fc-ae3d-ffc71cd5ee66 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:27.034396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40590ed8-2502-48fc-ae3d-ffc71cd5ee66 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:27.034664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40590ed8-2502-48fc-ae3d-ffc71cd5ee66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:27.036257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-40590ed8-2502-48fc-ae3d-ffc71cd5ee66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:27.084647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:27.125649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40590ed8-2502-48fc-ae3d-ffc71cd5ee66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:27.127243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40590ed8-2502-48fc-ae3d-ffc71cd5ee66 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:27.145137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 706/1428] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:28.213433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1ff4-1b1e-418c-9b3d-12a3de655c6a None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:28.214014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1ff4-1b1e-418c-9b3d-12a3de655c6a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:28.214014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ab1ff4-1b1e-418c-9b3d-12a3de655c6a None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:28.215308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 723/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:28.221527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c97eb-2961-4471-97dc-3a696d2b1c08 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:28.221989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c97eb-2961-4471-97dc-3a696d2b1c08 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:28.222094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c97eb-2961-4471-97dc-3a696d2b1c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:28.296395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f72c97eb-2961-4471-97dc-3a696d2b1c08 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:28.297603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f72c97eb-2961-4471-97dc-3a696d2b1c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:28.391881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 707/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:28.542347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1ff4-1b1e-418c-9b3d-12a3de655c6a None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:28.543873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f6ab1ff4-1b1e-418c-9b3d-12a3de655c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:28.592517 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:28.688927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ab1ff4-1b1e-418c-9b3d-12a3de655c6a None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:28.797944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376bbb9-6e62-40f1-aab5-99030515fb18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:28.798545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376bbb9-6e62-40f1-aab5-99030515fb18 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:28.798818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376bbb9-6e62-40f1-aab5-99030515fb18 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:28.799086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376bbb9-6e62-40f1-aab5-99030515fb18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:28.800647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4376bbb9-6e62-40f1-aab5-99030515fb18 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:28.807309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:28.888143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376bbb9-6e62-40f1-aab5-99030515fb18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:28.889761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376bbb9-6e62-40f1-aab5-99030515fb18 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:28.907678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 724/1431] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:29.949257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc3fe6-532d-4ca2-9888-32114c964cc8 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:29.949851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc3fe6-532d-4ca2-9888-32114c964cc8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:29.949851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cc3fe6-532d-4ca2-9888-32114c964cc8 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:29.951284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 708/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:29.958085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb641c-cad1-4aa3-944c-a048c688e117 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:29.958529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb641c-cad1-4aa3-944c-a048c688e117 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:29.958634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eb641c-cad1-4aa3-944c-a048c688e117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:30.034669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-01eb641c-cad1-4aa3-944c-a048c688e117 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:30.035874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-01eb641c-cad1-4aa3-944c-a048c688e117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:30.102303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:30.130320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 725/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:30.279735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc3fe6-532d-4ca2-9888-32114c964cc8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:30.281239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-49cc3fe6-532d-4ca2-9888-32114c964cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:30.298380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:30.427115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cc3fe6-532d-4ca2-9888-32114c964cc8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:30.512194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:30.537985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c660089-d426-4344-903d-8ae4a211bb50 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:30.538591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660089-d426-4344-903d-8ae4a211bb50 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:30.538869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660089-d426-4344-903d-8ae4a211bb50 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:30.539150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c660089-d426-4344-903d-8ae4a211bb50 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:30.540728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7c660089-d426-4344-903d-8ae4a211bb50 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:30.629031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660089-d426-4344-903d-8ae4a211bb50 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:30.630652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c660089-d426-4344-903d-8ae4a211bb50 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:30.648138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 709/1434] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:31.687562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829ed1e-0345-4bea-abc9-84a4dd184a36 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:31.688089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829ed1e-0345-4bea-abc9-84a4dd184a36 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:31.688089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c829ed1e-0345-4bea-abc9-84a4dd184a36 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:31.689439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 726/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:31.695737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630e219-8212-49c1-8388-cf1208a39470 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:31.696181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630e219-8212-49c1-8388-cf1208a39470 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:31.696290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e630e219-8212-49c1-8388-cf1208a39470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:31.778896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e630e219-8212-49c1-8388-cf1208a39470 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:31.780101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e630e219-8212-49c1-8388-cf1208a39470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:31.821622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:31.876288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 710/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:32.024379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829ed1e-0345-4bea-abc9-84a4dd184a36 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:32.026001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c829ed1e-0345-4bea-abc9-84a4dd184a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:32.169970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c829ed1e-0345-4bea-abc9-84a4dd184a36 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:32.225525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:32.283155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf70b3-1b21-4549-8b76-e8595c3005c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:32.283703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf70b3-1b21-4549-8b76-e8595c3005c4 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:32.283979 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf70b3-1b21-4549-8b76-e8595c3005c4 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:32.284247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf70b3-1b21-4549-8b76-e8595c3005c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:32.285858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8cdf70b3-1b21-4549-8b76-e8595c3005c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:32.373623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf70b3-1b21-4549-8b76-e8595c3005c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:32.375198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf70b3-1b21-4549-8b76-e8595c3005c4 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:32.393134 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 727/1437] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:33.433593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98a3b6-01e8-4a60-a12a-1d0f7021f399 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:33.434076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98a3b6-01e8-4a60-a12a-1d0f7021f399 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:33.434175 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98a3b6-01e8-4a60-a12a-1d0f7021f399 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:33.435500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 711/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:42:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:33.442412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20986-e830-42ed-9cdd-69391b005da8 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:33.442863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20986-e830-42ed-9cdd-69391b005da8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:33.442967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e20986-e830-42ed-9cdd-69391b005da8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:33.520175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-61e20986-e830-42ed-9cdd-69391b005da8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:33.521386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-61e20986-e830-42ed-9cdd-69391b005da8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:33.523480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:33.615927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 728/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:42:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:33.765051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98a3b6-01e8-4a60-a12a-1d0f7021f399 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:33.766624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bb98a3b6-01e8-4a60-a12a-1d0f7021f399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:33.910056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98a3b6-01e8-4a60-a12a-1d0f7021f399 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:33.936434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:34.027166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4ae39-7ff2-4a93-8a8b-2557d0a4546c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:34.027692 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ae39-7ff2-4a93-8a8b-2557d0a4546c service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:34.027964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ae39-7ff2-4a93-8a8b-2557d0a4546c service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:34.028232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4ae39-7ff2-4a93-8a8b-2557d0a4546c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:34.029848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2bb4ae39-7ff2-4a93-8a8b-2557d0a4546c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:34.118065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4ae39-7ff2-4a93-8a8b-2557d0a4546c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:34.119670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4ae39-7ff2-4a93-8a8b-2557d0a4546c service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:34.138056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 712/1440] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:36.270999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915a690-c38a-4223-86a1-18d4ff3b9167 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:36.271436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915a690-c38a-4223-86a1-18d4ff3b9167 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:36.271547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915a690-c38a-4223-86a1-18d4ff3b9167 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:36.272876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 729/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:36.278359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe651ba-f5ae-494b-95a7-73ad75973ee5 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:36.278746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe651ba-f5ae-494b-95a7-73ad75973ee5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:36.278839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe651ba-f5ae-494b-95a7-73ad75973ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:36.320203 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:36.349206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-4fe651ba-f5ae-494b-95a7-73ad75973ee5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:36.350478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4fe651ba-f5ae-494b-95a7-73ad75973ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:36.446196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 713/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:36.730581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915a690-c38a-4223-86a1-18d4ff3b9167 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:36.732087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e915a690-c38a-4223-86a1-18d4ff3b9167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:36.832615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e915a690-c38a-4223-86a1-18d4ff3b9167 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:36.865042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:36.905037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c32a1-961e-4b97-a8ac-a2b2c20c8123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:36.906200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c32a1-961e-4b97-a8ac-a2b2c20c8123 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:36.906477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c32a1-961e-4b97-a8ac-a2b2c20c8123 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:36.906745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c32a1-961e-4b97-a8ac-a2b2c20c8123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:36.908318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-165c32a1-961e-4b97-a8ac-a2b2c20c8123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:37.014107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c32a1-961e-4b97-a8ac-a2b2c20c8123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:37.016022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c32a1-961e-4b97-a8ac-a2b2c20c8123 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:37.036845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 730/1443] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:39.306443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774e04-d50b-4b1a-968a-64de1a68177e None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:39.307018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774e04-d50b-4b1a-968a-64de1a68177e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:39.307018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df774e04-d50b-4b1a-968a-64de1a68177e None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:39.308335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 714/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:39.314109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5415-32de-4213-b78b-49c720e904fb None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:39.314536 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5415-32de-4213-b78b-49c720e904fb None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:39.314646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5c5415-32de-4213-b78b-49c720e904fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:39.383233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0f5c5415-32de-4213-b78b-49c720e904fb None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:39.384438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0f5c5415-32de-4213-b78b-49c720e904fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:39.397014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:39.480256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 731/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:39.762396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df774e04-d50b-4b1a-968a-64de1a68177e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:39.763916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-df774e04-d50b-4b1a-968a-64de1a68177e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:39.868357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df774e04-d50b-4b1a-968a-64de1a68177e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:39.881391 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:39.942109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c34d9b-e562-40aa-ab99-d3be34af55fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:39.942714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34d9b-e562-40aa-ab99-d3be34af55fb service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:39.943000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34d9b-e562-40aa-ab99-d3be34af55fb service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:39.943274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c34d9b-e562-40aa-ab99-d3be34af55fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:39.944856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-79c34d9b-e562-40aa-ab99-d3be34af55fb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:40.052542 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c34d9b-e562-40aa-ab99-d3be34af55fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:40.053936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c34d9b-e562-40aa-ab99-d3be34af55fb service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:40.071931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 715/1446] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:42.535573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f119938-0f2a-493b-8bdc-fa4c33385bb1 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:42.536130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f119938-0f2a-493b-8bdc-fa4c33385bb1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:42.536130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f119938-0f2a-493b-8bdc-fa4c33385bb1 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:42.537450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 732/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:42.542817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd4fc4-6e68-4552-bed2-d2c2a5d7bdc6 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:42.543262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd4fc4-6e68-4552-bed2-d2c2a5d7bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:42.543372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd4fc4-6e68-4552-bed2-d2c2a5d7bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:42.590829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:42.609782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-70dd4fc4-6e68-4552-bed2-d2c2a5d7bdc6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:42.610987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-70dd4fc4-6e68-4552-bed2-d2c2a5d7bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:42.705636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 716/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:42:42.993945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f119938-0f2a-493b-8bdc-fa4c33385bb1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:42.995458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6f119938-0f2a-493b-8bdc-fa4c33385bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:43.096209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f119938-0f2a-493b-8bdc-fa4c33385bb1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:43.135899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:43.169831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56200d49-df7a-4534-902f-eba42734d42b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:43.170422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200d49-df7a-4534-902f-eba42734d42b service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:43.171202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200d49-df7a-4534-902f-eba42734d42b service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:43.171468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56200d49-df7a-4534-902f-eba42734d42b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:43.173022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-56200d49-df7a-4534-902f-eba42734d42b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:43.278806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56200d49-df7a-4534-902f-eba42734d42b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:43.280829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56200d49-df7a-4534-902f-eba42734d42b service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:43.298302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 733/1449] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:45.563572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96360-4350-4cf5-b6f1-3508dcacb6d3 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:45.564127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96360-4350-4cf5-b6f1-3508dcacb6d3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:45.564127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb96360-4350-4cf5-b6f1-3508dcacb6d3 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:45.565533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 717/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:45.570688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f50ad0-5a41-4624-8889-1af8dadd3668 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:45.571107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f50ad0-5a41-4624-8889-1af8dadd3668 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:45.571219 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f50ad0-5a41-4624-8889-1af8dadd3668 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:45.637363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-48f50ad0-5a41-4624-8889-1af8dadd3668 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:45.638609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-48f50ad0-5a41-4624-8889-1af8dadd3668 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:45.658875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:45.735167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 734/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:46.019649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb96360-4350-4cf5-b6f1-3508dcacb6d3 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:46.021303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-fbb96360-4350-4cf5-b6f1-3508dcacb6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:46.127455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb96360-4350-4cf5-b6f1-3508dcacb6d3 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:46.147377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:46.200479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed955d62-4e91-4a3a-bcad-10830c917434 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:46.201079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955d62-4e91-4a3a-bcad-10830c917434 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:46.201356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955d62-4e91-4a3a-bcad-10830c917434 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:46.201662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed955d62-4e91-4a3a-bcad-10830c917434 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:46.203251 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ed955d62-4e91-4a3a-bcad-10830c917434 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:46.316789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed955d62-4e91-4a3a-bcad-10830c917434 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:46.318787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed955d62-4e91-4a3a-bcad-10830c917434 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:46.337593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 718/1452] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:48.625795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762145a-c5ae-43d8-956b-ad5223fc7d68 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:48.626347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762145a-c5ae-43d8-956b-ad5223fc7d68 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:48.626347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762145a-c5ae-43d8-956b-ad5223fc7d68 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:48.627652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 735/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:48.632866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187f143-26e8-4b71-a721-de8ee22621a9 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:48.633294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187f143-26e8-4b71-a721-de8ee22621a9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:48.633432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187f143-26e8-4b71-a721-de8ee22621a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:48.696975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:48.699707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-1187f143-26e8-4b71-a721-de8ee22621a9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:48.702161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1187f143-26e8-4b71-a721-de8ee22621a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:48.795728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 719/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:49.095893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762145a-c5ae-43d8-956b-ad5223fc7d68 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:49.097457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9762145a-c5ae-43d8-956b-ad5223fc7d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:49.203509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762145a-c5ae-43d8-956b-ad5223fc7d68 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:49.252218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:49.276772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178a3d6-bbbe-43ae-a4d1-a08aeebe2738 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:49.277380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178a3d6-bbbe-43ae-a4d1-a08aeebe2738 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:49.277685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178a3d6-bbbe-43ae-a4d1-a08aeebe2738 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:49.277955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178a3d6-bbbe-43ae-a4d1-a08aeebe2738 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:49.279526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6178a3d6-bbbe-43ae-a4d1-a08aeebe2738 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:49.386440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178a3d6-bbbe-43ae-a4d1-a08aeebe2738 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:49.387779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178a3d6-bbbe-43ae-a4d1-a08aeebe2738 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:49.405760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 736/1455] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:51.675783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2ecf4-88fe-43bf-bbd5-51d34cc9dfa0 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:51.676297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2ecf4-88fe-43bf-bbd5-51d34cc9dfa0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:51.676297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e2ecf4-88fe-43bf-bbd5-51d34cc9dfa0 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:51.677641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 720/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:51.683061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fbdac-0870-45b5-a7df-adf77fe9d95a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:51.683520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fbdac-0870-45b5-a7df-adf77fe9d95a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:51.683722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1fbdac-0870-45b5-a7df-adf77fe9d95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:51.750284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ca1fbdac-0870-45b5-a7df-adf77fe9d95a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:51.751484 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ca1fbdac-0870-45b5-a7df-adf77fe9d95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:51.781911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:51.847779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 737/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:52.128986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2ecf4-88fe-43bf-bbd5-51d34cc9dfa0 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:52.130576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-53e2ecf4-88fe-43bf-bbd5-51d34cc9dfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:52.231224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e2ecf4-88fe-43bf-bbd5-51d34cc9dfa0 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:52.260728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:52.305685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738aa8e4-34dc-42c9-96bc-757dd065b8a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:52.306282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aa8e4-34dc-42c9-96bc-757dd065b8a7 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:52.306555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aa8e4-34dc-42c9-96bc-757dd065b8a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:52.306829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738aa8e4-34dc-42c9-96bc-757dd065b8a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:52.308386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-738aa8e4-34dc-42c9-96bc-757dd065b8a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:52.415781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aa8e4-34dc-42c9-96bc-757dd065b8a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:52.417161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738aa8e4-34dc-42c9-96bc-757dd065b8a7 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:52.435556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 721/1458] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:54.636143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3293cf-31e3-4920-8163-becd85f84ab3 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:54.636651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3293cf-31e3-4920-8163-becd85f84ab3 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:54.636651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3293cf-31e3-4920-8163-becd85f84ab3 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:54.637965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 738/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:54.643678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c043a-688b-46e0-8f91-2ebfe4744886 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:54.644138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c043a-688b-46e0-8f91-2ebfe4744886 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:54.644248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c043a-688b-46e0-8f91-2ebfe4744886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:54.709932 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d84c043a-688b-46e0-8f91-2ebfe4744886 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:54.711132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d84c043a-688b-46e0-8f91-2ebfe4744886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:54.719707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:54.808236 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 722/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:55.089499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3293cf-31e3-4920-8163-becd85f84ab3 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:55.091038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ee3293cf-31e3-4920-8163-becd85f84ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:55.192239 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3293cf-31e3-4920-8163-becd85f84ab3 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:55.246505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:55.264651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a09d559-f68f-49aa-8b65-7cfa7fcd8bff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:55.265257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09d559-f68f-49aa-8b65-7cfa7fcd8bff service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:55.265565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09d559-f68f-49aa-8b65-7cfa7fcd8bff service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:55.265834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a09d559-f68f-49aa-8b65-7cfa7fcd8bff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:55.267425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5a09d559-f68f-49aa-8b65-7cfa7fcd8bff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:55.374869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09d559-f68f-49aa-8b65-7cfa7fcd8bff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:55.376226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a09d559-f68f-49aa-8b65-7cfa7fcd8bff service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:55.394073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 739/1461] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:42:57.571122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea798f3-1cd0-4537-93bf-4989218bfe61 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:57.571743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea798f3-1cd0-4537-93bf-4989218bfe61 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:57.571743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea798f3-1cd0-4537-93bf-4989218bfe61 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:57.573032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 723/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:42:57.578252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda161df-a58a-4aae-a5c4-85af77a64627 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:57.578676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda161df-a58a-4aae-a5c4-85af77a64627 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:57.578801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda161df-a58a-4aae-a5c4-85af77a64627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:57.642947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-eda161df-a58a-4aae-a5c4-85af77a64627 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:42:57.644136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-eda161df-a58a-4aae-a5c4-85af77a64627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:57.683896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:57.741106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 740/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:42:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:42:58.021675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea798f3-1cd0-4537-93bf-4989218bfe61 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:42:58.023380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-dea798f3-1cd0-4537-93bf-4989218bfe61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:58.126069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea798f3-1cd0-4537-93bf-4989218bfe61 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:42:58.162136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:42:58.198703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d531d0-5c45-4e45-a96d-5ef50f7dfcbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:42:58.199297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d531d0-5c45-4e45-a96d-5ef50f7dfcbc service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:42:58.199576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d531d0-5c45-4e45-a96d-5ef50f7dfcbc service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:42:58.199846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d531d0-5c45-4e45-a96d-5ef50f7dfcbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:42:58.201457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d5d531d0-5c45-4e45-a96d-5ef50f7dfcbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:42:58.310300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d531d0-5c45-4e45-a96d-5ef50f7dfcbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:42:58.311762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d531d0-5c45-4e45-a96d-5ef50f7dfcbc service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:42:58.330623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 724/1464] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:00.460668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9222157-a4a3-407b-b170-d6dc7b794021 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:00.461219 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9222157-a4a3-407b-b170-d6dc7b794021 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:00.461219 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9222157-a4a3-407b-b170-d6dc7b794021 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:00.462586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 741/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:00.468030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4144b-5466-4632-860d-99f40f98da11 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:00.468441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4144b-5466-4632-860d-99f40f98da11 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:00.468584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d4144b-5466-4632-860d-99f40f98da11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:00.535394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-c2d4144b-5466-4632-860d-99f40f98da11 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:00.536502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c2d4144b-5466-4632-860d-99f40f98da11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:00.554442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:00.631197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 725/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:00.913027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9222157-a4a3-407b-b170-d6dc7b794021 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:00.914624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c9222157-a4a3-407b-b170-d6dc7b794021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:01.016772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9222157-a4a3-407b-b170-d6dc7b794021 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:01.083447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:01.090663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fa3f84-8bc0-44cf-8de1-80223c0a3dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:01.091269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa3f84-8bc0-44cf-8de1-80223c0a3dec service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:01.091548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa3f84-8bc0-44cf-8de1-80223c0a3dec service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:01.091849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fa3f84-8bc0-44cf-8de1-80223c0a3dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:01.093482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f1fa3f84-8bc0-44cf-8de1-80223c0a3dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:01.198305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa3f84-8bc0-44cf-8de1-80223c0a3dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:01.199656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fa3f84-8bc0-44cf-8de1-80223c0a3dec service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:01.217160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 742/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:03.406793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7efdf-721f-4268-93ae-d1fd2cf724a5 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:03.407370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7efdf-721f-4268-93ae-d1fd2cf724a5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:03.407370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7efdf-721f-4268-93ae-d1fd2cf724a5 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:03.408750 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 726/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:03.414115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab921d2-bd11-4a84-a75c-f7124a99fa14 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:03.414515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab921d2-bd11-4a84-a75c-f7124a99fa14 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:03.414673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab921d2-bd11-4a84-a75c-f7124a99fa14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:03.480395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-9ab921d2-bd11-4a84-a75c-f7124a99fa14 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:03.481609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9ab921d2-bd11-4a84-a75c-f7124a99fa14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:03.531428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:03.580678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 743/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:03.866887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7efdf-721f-4268-93ae-d1fd2cf724a5 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:03.868504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-faa7efdf-721f-4268-93ae-d1fd2cf724a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:03.970474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7efdf-721f-4268-93ae-d1fd2cf724a5 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:04.018206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:04.047111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787212a5-5505-49ac-8b57-776307c4f858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:04.047721 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787212a5-5505-49ac-8b57-776307c4f858 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:04.047997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787212a5-5505-49ac-8b57-776307c4f858 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:04.048273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787212a5-5505-49ac-8b57-776307c4f858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:04.049886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-787212a5-5505-49ac-8b57-776307c4f858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:04.156847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787212a5-5505-49ac-8b57-776307c4f858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:04.158232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787212a5-5505-49ac-8b57-776307c4f858 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:04.175434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 727/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:13.579160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=22 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:14.173238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=66 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:24.209235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2626db9-77e7-4423-9ce3-b48350e5dccd None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:24.209915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2626db9-77e7-4423-9ce3-b48350e5dccd None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:24.209915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2626db9-77e7-4423-9ce3-b48350e5dccd None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:24.211189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 744/1471] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:24.217382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9ea06-339b-4f01-b5ec-81d7f82ea63e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:24.217793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9ea06-339b-4f01-b5ec-81d7f82ea63e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:24.217956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa9ea06-339b-4f01-b5ec-81d7f82ea63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:24.285173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-aaa9ea06-339b-4f01-b5ec-81d7f82ea63e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:24.286429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-aaa9ea06-339b-4f01-b5ec-81d7f82ea63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:24.379113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 728/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:24.677238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6746-b412-44ec-a133-20700ff7cccc None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:24.677557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6746-b412-44ec-a133-20700ff7cccc None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:24.677831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c6746-b412-44ec-a133-20700ff7cccc None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:24.679160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 745/1473] 10.222.0.16 () {54 vars in 962 bytes} [Sat Sep 17 00:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:24.683996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c801b-b830-4f64-8c5b-f1cb758bd512 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:24.684278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c801b-b830-4f64-8c5b-f1cb758bd512 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:24.685098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c801b-b830-4f64-8c5b-f1cb758bd512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:24.759616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-4c6c801b-b830-4f64-8c5b-f1cb758bd512 None None] MFA Rules not processed for user `babdd851ad7b4ba99b5746d8480bc082`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:24.760794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4c6c801b-b830-4f64-8c5b-f1cb758bd512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:24.781825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:24.836130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 729/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Sep 17 00:43:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:24.843981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6746-b412-44ec-a133-20700ff7cccc None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:24.845497 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ef4c6746-b412-44ec-a133-20700ff7cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:24.948387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c6746-b412-44ec-a133-20700ff7cccc None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:25.020138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc20746-574d-4d45-9e0b-c2f2a244e695 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babdd851ad7b4ba99b5746d8480bc082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:25.020740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20746-574d-4d45-9e0b-c2f2a244e695 service glance] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:25.021018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20746-574d-4d45-9e0b-c2f2a244e695 service glance] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:25.021287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc20746-574d-4d45-9e0b-c2f2a244e695 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:25.022883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4fc20746-574d-4d45-9e0b-c2f2a244e695 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:25.075273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:25.129569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20746-574d-4d45-9e0b-c2f2a244e695 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:25.130989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc20746-574d-4d45-9e0b-c2f2a244e695 service glance] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:25.148890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 746/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:27.371285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873072-0561-41b9-94f5-ee127d3c3470 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:27.371813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873072-0561-41b9-94f5-ee127d3c3470 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:27.371813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba873072-0561-41b9-94f5-ee127d3c3470 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:27.373940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 730/1476] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:43:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:27.379123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef86061-88c5-473e-831e-6c8386dcd419 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:27.379503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef86061-88c5-473e-831e-6c8386dcd419 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:27.379680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef86061-88c5-473e-831e-6c8386dcd419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:27.445039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7ef86061-88c5-473e-831e-6c8386dcd419 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:27.446282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7ef86061-88c5-473e-831e-6c8386dcd419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:27.546419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 747/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:27.828079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873072-0561-41b9-94f5-ee127d3c3470 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:27.829629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ba873072-0561-41b9-94f5-ee127d3c3470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:27.952071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba873072-0561-41b9-94f5-ee127d3c3470 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:28.001533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:28.047723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7540a9da-016a-429b-91d9-957f843f9b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:28.048327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a9da-016a-429b-91d9-957f843f9b59 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:28.048608 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a9da-016a-429b-91d9-957f843f9b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:28.048882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7540a9da-016a-429b-91d9-957f843f9b59 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:28.049553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540a9da-016a-429b-91d9-957f843f9b59 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:28.051357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING py.warnings [None req-7540a9da-016a-429b-91d9-957f843f9b59 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:43:28.051357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: warnings.warn(msg) Sep 17 00:43:28.051357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: Sep 17 00:43:28.052513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7540a9da-016a-429b-91d9-957f843f9b59 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:28.071117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 731/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 17 00:43:27 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:43:30.223863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5e3da-3ceb-4755-a748-324efdcbd58b None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:30.224421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5e3da-3ceb-4755-a748-324efdcbd58b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:30.224421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d5e3da-3ceb-4755-a748-324efdcbd58b None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:30.225781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 748/1479] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:30.230946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dda040-324f-4227-8adc-f4f33a21ef52 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:30.231947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dda040-324f-4227-8adc-f4f33a21ef52 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:30.232079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dda040-324f-4227-8adc-f4f33a21ef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:30.298456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d2dda040-324f-4227-8adc-f4f33a21ef52 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:30.299644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d2dda040-324f-4227-8adc-f4f33a21ef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:30.394146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 732/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:30.687383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5e3da-3ceb-4755-a748-324efdcbd58b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:30.688911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-73d5e3da-3ceb-4755-a748-324efdcbd58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:30.698630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:30.831331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d5e3da-3ceb-4755-a748-324efdcbd58b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:30.909078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:30.941756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607eddab-cad0-4c0b-bf19-0a715083a332 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:30.942299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eddab-cad0-4c0b-bf19-0a715083a332 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:30.942577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eddab-cad0-4c0b-bf19-0a715083a332 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:30.942846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607eddab-cad0-4c0b-bf19-0a715083a332 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:30.944416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-607eddab-cad0-4c0b-bf19-0a715083a332 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:31.033882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eddab-cad0-4c0b-bf19-0a715083a332 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:31.035571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607eddab-cad0-4c0b-bf19-0a715083a332 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:31.053015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 749/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:33.375457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9275cbf-b5ea-45f3-871b-6e22e4abfa11 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:33.376036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9275cbf-b5ea-45f3-871b-6e22e4abfa11 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:33.376036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9275cbf-b5ea-45f3-871b-6e22e4abfa11 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:33.377354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 733/1482] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:33.382805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774ffe9-66d3-4fc3-abf7-16b4e6139bed None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:33.383215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774ffe9-66d3-4fc3-abf7-16b4e6139bed None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:33.383364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2774ffe9-66d3-4fc3-abf7-16b4e6139bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:33.449042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2774ffe9-66d3-4fc3-abf7-16b4e6139bed None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:33.450333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2774ffe9-66d3-4fc3-abf7-16b4e6139bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:33.507063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:33.562817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 750/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:33.848995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9275cbf-b5ea-45f3-871b-6e22e4abfa11 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:33.850562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a9275cbf-b5ea-45f3-871b-6e22e4abfa11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:33.874214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:33.951306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9275cbf-b5ea-45f3-871b-6e22e4abfa11 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:34.024628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d3fb36-74ce-49d3-ba2d-5048e4575aee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:34.025238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3fb36-74ce-49d3-ba2d-5048e4575aee service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:34.025546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3fb36-74ce-49d3-ba2d-5048e4575aee service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:34.025821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d3fb36-74ce-49d3-ba2d-5048e4575aee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:34.027406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-23d3fb36-74ce-49d3-ba2d-5048e4575aee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:34.100288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:34.134422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3fb36-74ce-49d3-ba2d-5048e4575aee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:34.135863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d3fb36-74ce-49d3-ba2d-5048e4575aee service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:34.154918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 734/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:36.383755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f5940-a2a9-401b-8050-de144e484098 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:36.384319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f5940-a2a9-401b-8050-de144e484098 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:36.384319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f5940-a2a9-401b-8050-de144e484098 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:36.385734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 751/1485] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:36.391377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9173d-8c7a-4cc6-acf5-14e0d3967fa4 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:36.391804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9173d-8c7a-4cc6-acf5-14e0d3967fa4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:36.391934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd9173d-8c7a-4cc6-acf5-14e0d3967fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:36.468583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7fd9173d-8c7a-4cc6-acf5-14e0d3967fa4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:36.469812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7fd9173d-8c7a-4cc6-acf5-14e0d3967fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:36.569328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 735/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:36.858922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f5940-a2a9-401b-8050-de144e484098 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:36.860438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-126f5940-a2a9-401b-8050-de144e484098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:36.961161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f5940-a2a9-401b-8050-de144e484098 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:37.031688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:37.033186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f064267e-4588-428f-892a-13f2082251b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:37.033825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064267e-4588-428f-892a-13f2082251b8 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:37.034326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064267e-4588-428f-892a-13f2082251b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:37.034772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f064267e-4588-428f-892a-13f2082251b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:37.036600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f064267e-4588-428f-892a-13f2082251b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:37.150040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064267e-4588-428f-892a-13f2082251b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:37.152465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f064267e-4588-428f-892a-13f2082251b8 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:37.171735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 752/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:39.383934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50500-a04b-4d8e-aeaa-84988c173075 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:39.384501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50500-a04b-4d8e-aeaa-84988c173075 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:39.384501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd50500-a04b-4d8e-aeaa-84988c173075 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:39.385899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 736/1488] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:39.393690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c25c-5417-4c6a-9e0f-0b4bba58d227 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:39.394090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c25c-5417-4c6a-9e0f-0b4bba58d227 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:39.394277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b88c25c-5417-4c6a-9e0f-0b4bba58d227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:39.467812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6b88c25c-5417-4c6a-9e0f-0b4bba58d227 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:39.469010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6b88c25c-5417-4c6a-9e0f-0b4bba58d227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:39.519826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:39.563266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 753/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:39.854477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd50500-a04b-4d8e-aeaa-84988c173075 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:39.856609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-afd50500-a04b-4d8e-aeaa-84988c173075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:39.891433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:39.958645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd50500-a04b-4d8e-aeaa-84988c173075 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:40.030331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239f96cd-4a79-41c8-9ee8-c847b8a386bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:40.031003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f96cd-4a79-41c8-9ee8-c847b8a386bb service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:40.031285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f96cd-4a79-41c8-9ee8-c847b8a386bb service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:40.031560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239f96cd-4a79-41c8-9ee8-c847b8a386bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:40.033144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-239f96cd-4a79-41c8-9ee8-c847b8a386bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:40.112000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:40.141260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f96cd-4a79-41c8-9ee8-c847b8a386bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:40.142738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239f96cd-4a79-41c8-9ee8-c847b8a386bb service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:40.160139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 737/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:42.520657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772956d-6f36-4aa4-830a-97306f8bdd98 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:42.521179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772956d-6f36-4aa4-830a-97306f8bdd98 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:42.521179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f772956d-6f36-4aa4-830a-97306f8bdd98 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:42.522517 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 754/1491] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 17 00:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:43:42.528190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa26a7-726a-42d4-a183-5a1867ff3a7f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:42.528637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa26a7-726a-42d4-a183-5a1867ff3a7f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:42.528742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa26a7-726a-42d4-a183-5a1867ff3a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:42.597237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d5fa26a7-726a-42d4-a183-5a1867ff3a7f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:43:42.598493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d5fa26a7-726a-42d4-a183-5a1867ff3a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:42.693245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 738/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 17 00:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:43:42.984358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772956d-6f36-4aa4-830a-97306f8bdd98 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:43:42.985920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f772956d-6f36-4aa4-830a-97306f8bdd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:43.087537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f772956d-6f36-4aa4-830a-97306f8bdd98 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:43:43.159525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81be3123-00f6-4d99-9a36-9eecfa02ba10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:43:43.160124 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3123-00f6-4d99-9a36-9eecfa02ba10 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:43:43.160397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3123-00f6-4d99-9a36-9eecfa02ba10 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:43:43.160664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81be3123-00f6-4d99-9a36-9eecfa02ba10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:43:43.162259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-81be3123-00f6-4d99-9a36-9eecfa02ba10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:43:43.170699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:43.268002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be3123-00f6-4d99-9a36-9eecfa02ba10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:43:43.269435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81be3123-00f6-4d99-9a36-9eecfa02ba10 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:43:43.288210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 755/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:43:52.691817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=82 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:43:53.285966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=50 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:02.518243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce21e-5040-433c-9a9f-9bb9f2ff1c3b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:02.518788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce21e-5040-433c-9a9f-9bb9f2ff1c3b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:02.518788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0ce21e-5040-433c-9a9f-9bb9f2ff1c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:02.593247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8c0ce21e-5040-433c-9a9f-9bb9f2ff1c3b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:02.594392 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8c0ce21e-5040-433c-9a9f-9bb9f2ff1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:02.688636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 739/1494] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:02.696441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247fc62-f41f-4785-b894-b6d48a736968 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:02.696921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247fc62-f41f-4785-b894-b6d48a736968 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:02.697027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247fc62-f41f-4785-b894-b6d48a736968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:02.770058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f247fc62-f41f-4785-b894-b6d48a736968 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:02.771244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f247fc62-f41f-4785-b894-b6d48a736968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:02.866162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 756/1495] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:45:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:02.871297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ce21e-5040-433c-9a9f-9bb9f2ff1c3b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:02.872498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8c0ce21e-5040-433c-9a9f-9bb9f2ff1c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:02.883793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0ce21e-5040-433c-9a9f-9bb9f2ff1c3b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:02.944357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:02.979057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:02.979660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:02.979938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:02.980206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:02.980848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:45:02.981148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:02.982309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING py.warnings [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:02.982309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: warnings.warn(msg) Sep 17 00:45:02.982309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: Sep 17 00:45:02.983197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:02.994125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 740/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:45:03.002514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247fc62-f41f-4785-b894-b6d48a736968 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:03.011410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247fc62-f41f-4785-b894-b6d48a736968 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:03.072465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:03.107119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:03.107725 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.108004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.108278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.108913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:03.110649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WARNING py.warnings [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:03.110649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: warnings.warn(msg) Sep 17 00:45:03.110649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: Sep 17 00:45:03.111846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:03.166529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 757/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:45:03 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:45:03.170768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:03.172316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:03.204603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d9fcf-32de-4877-9614-87f107ba3914 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:03.296652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:03.297260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.297578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.297854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.298498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:03.299540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING py.warnings [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:03.299540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: warnings.warn(msg) Sep 17 00:45:03.299540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: Sep 17 00:45:03.300755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:03.343087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 741/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:45:03 2022] POST /identity/v3/users => generated 290 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:45:03.347359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:03.348922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:03.409396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec318a7-d364-44ec-a27d-784b6eac0e0f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:03.491266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:03.502518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:03.503117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.503396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.503664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.504299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:03.505316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WARNING py.warnings [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:03.505316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: warnings.warn(msg) Sep 17 00:45:03.505316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: Sep 17 00:45:03.506230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:03.518676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 758/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:45:03.522839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:03.524356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:03.536386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4286d-2016-4bc1-b4d7-9522abfeb3ef admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:03.561224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:03.635466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd01ea7-e323-4307-afcf-c0f9b966fcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:03.636074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01ea7-e323-4307-afcf-c0f9b966fcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.636350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01ea7-e323-4307-afcf-c0f9b966fcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.636625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd01ea7-e323-4307-afcf-c0f9b966fcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.637259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd01ea7-e323-4307-afcf-c0f9b966fcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:03.638319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING py.warnings [None req-9bd01ea7-e323-4307-afcf-c0f9b966fcc6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:03.638319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: warnings.warn(msg) Sep 17 00:45:03.638319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: Sep 17 00:45:03.639205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd01ea7-e323-4307-afcf-c0f9b966fcc6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:03.652070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 742/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:45:03.656244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:03.657795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:03.690774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63267f0-ca54-48ab-a203-1ef87a80686a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:03.782751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2b1ab-b810-44e3-883c-b96363f15022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:03.783388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2b1ab-b810-44e3-883c-b96363f15022 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.783667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2b1ab-b810-44e3-883c-b96363f15022 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.783939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2b1ab-b810-44e3-883c-b96363f15022 admin admin] PATH_INFO: `/v3/projects/f62e2f329b3a40698419eed2574f9775/users/cc59f287bc9a445aa3ce5d5ec1c7497a/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.806643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2b1ab-b810-44e3-883c-b96363f15022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f62e2f329b3a40698419eed2574f9775, user_id=cc59f287bc9a445aa3ce5d5ec1c7497a, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:03.807673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WARNING py.warnings [None req-a0a2b1ab-b810-44e3-883c-b96363f15022 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:03.807673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: warnings.warn(msg) Sep 17 00:45:03.807673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: Sep 17 00:45:03.809658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2b1ab-b810-44e3-883c-b96363f15022 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:03.833963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 759/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:45:03 2022] PUT /identity/v3/projects/f62e2f329b3a40698419eed2574f9775/users/cc59f287bc9a445aa3ce5d5ec1c7497a/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:45:03.846540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ffc2-6625-4a97-bcef-c48b09806692 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.846833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ffc2-6625-4a97-bcef-c48b09806692 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.847109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ffc2-6625-4a97-bcef-c48b09806692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.903291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-27e5ffc2-6625-4a97-bcef-c48b09806692 None None] MFA Rules not processed for user `cc59f287bc9a445aa3ce5d5ec1c7497a`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:03.904483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-27e5ffc2-6625-4a97-bcef-c48b09806692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:03.979364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 743/1502] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:45:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:03.992514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba437364-3eae-43e1-98bf-310f016b1a27 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.992807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba437364-3eae-43e1-98bf-310f016b1a27 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:03.993088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba437364-3eae-43e1-98bf-310f016b1a27 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:03.994947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 760/1503] 10.222.0.16 () {54 vars in 964 bytes} [Sat Sep 17 00:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:45:03.999535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0142b-4031-4187-8465-f4a825685564 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:03.999819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0142b-4031-4187-8465-f4a825685564 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.000095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f0142b-4031-4187-8465-f4a825685564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.032085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:04.077058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-95f0142b-4031-4187-8465-f4a825685564 None None] MFA Rules not processed for user `29e517f2741c4f14877ba49d5be2229a`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:04.078293 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-95f0142b-4031-4187-8465-f4a825685564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.151911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 744/1504] 10.222.0.16 () {58 vars in 1061 bytes} [Sat Sep 17 00:45:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:04.159549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba437364-3eae-43e1-98bf-310f016b1a27 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:04.161043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ba437364-3eae-43e1-98bf-310f016b1a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.210728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:04.265498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba437364-3eae-43e1-98bf-310f016b1a27 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:04.336060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:04.336556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.336829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.337125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.338966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.435686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:04.437097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:04.440556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:04.454916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 761/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:45:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:45:04.501092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbfea-a7cd-4714-b051-58a82ff56bf3 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.501383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbfea-a7cd-4714-b051-58a82ff56bf3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.501727 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acbfea-a7cd-4714-b051-58a82ff56bf3 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.502987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 745/1506] 10.222.0.16 () {52 vars in 830 bytes} [Sat Sep 17 00:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:45:04.506491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:04.507694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.604130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a854f85b-5f08-496e-adda-86cbe2f5a40e service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:04.704221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:04.704841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.705115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.705383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] PATH_INFO: `/v3/users/cc59f287bc9a445aa3ce5d5ec1c7497a` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.718835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc59f287bc9a445aa3ce5d5ec1c7497a)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:04.719846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WARNING py.warnings [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:04.719846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: warnings.warn(msg) Sep 17 00:45:04.719846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: Sep 17 00:45:04.721048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:04.731057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:04.788350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc59f287bc9a445aa3ce5d5ec1c7497a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:04.797327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc59f287bc9a445aa3ce5d5ec1c7497a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:04.797777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc59f287bc9a445aa3ce5d5ec1c7497a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:04.812043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc59f287bc9a445aa3ce5d5ec1c7497a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:04.834357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc59f287bc9a445aa3ce5d5ec1c7497a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:04.840996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 762/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:45:04 2022] DELETE /identity/v3/users/cc59f287bc9a445aa3ce5d5ec1c7497a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:45:04.845453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a834b-fcef-45f6-885f-f23749b798c7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:04.845911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a834b-fcef-45f6-885f-f23749b798c7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:04.846006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a834b-fcef-45f6-885f-f23749b798c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:04.902492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8c8a834b-fcef-45f6-885f-f23749b798c7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:45:04.903586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8c8a834b-fcef-45f6-885f-f23749b798c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:04.976914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:04.989550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 746/1508] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:45:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:45:04.999046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:05.000255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:05.100170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921f049-2b2a-4b85-8e67-03e59007f83b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:05.154155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:05.174031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b1986a-bc54-4b2a-bae7-19bfe83a5d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:05.174622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1986a-bc54-4b2a-bae7-19bfe83a5d2f service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:05.174907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1986a-bc54-4b2a-bae7-19bfe83a5d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:05.175183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b1986a-bc54-4b2a-bae7-19bfe83a5d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:05.176752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-41b1986a-bc54-4b2a-bae7-19bfe83a5d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:05.282961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1986a-bc54-4b2a-bae7-19bfe83a5d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:05.284385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b1986a-bc54-4b2a-bae7-19bfe83a5d2f service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:05.302177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 763/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:45:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:45:05.670197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a834b-fcef-45f6-885f-f23749b798c7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:45:05.671368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8c8a834b-fcef-45f6-885f-f23749b798c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:45:05.684063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a834b-fcef-45f6-885f-f23749b798c7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:45:05.780855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:45:05.781519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:45:05.781802 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:45:05.782075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] PATH_INFO: `/v3/projects/f62e2f329b3a40698419eed2574f9775` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:45:05.792297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f62e2f329b3a40698419eed2574f9775)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:45:05.793326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING py.warnings [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:45:05.793326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: warnings.warn(msg) Sep 17 00:45:05.793326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: Sep 17 00:45:05.794576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:45:05.850653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f62e2f329b3a40698419eed2574f9775', 'request_id': 'req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.861546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f62e2f329b3a40698419eed2574f9775', 'request_id': 'req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.867846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f62e2f329b3a40698419eed2574f9775', 'request_id': 'req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.897276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] The token cache is being invalidate because project f62e2f329b3a40698419eed2574f9775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:45:05.897598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.898028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-577440f8-9d1b-4047-8dbf-4eb4f9d69eb2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:45:05.899916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 747/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:45:05 2022] DELETE /identity/v3/projects/f62e2f329b3a40698419eed2574f9775 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:45:15.299915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=62 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:45:15.895234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:46:35.351724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53ad01-0f73-4ba8-a209-87cab2d5020d None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:35.352331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53ad01-0f73-4ba8-a209-87cab2d5020d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:35.352331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab53ad01-0f73-4ba8-a209-87cab2d5020d None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:35.353668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 764/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:46:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:46:35.358610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c06b9-bcc9-4b2f-9392-0c2bea4d9167 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:35.359061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c06b9-bcc9-4b2f-9392-0c2bea4d9167 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:35.359167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c06b9-bcc9-4b2f-9392-0c2bea4d9167 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:35.444152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b14c06b9-bcc9-4b2f-9392-0c2bea4d9167 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:46:35.445360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b14c06b9-bcc9-4b2f-9392-0c2bea4d9167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:35.547460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 748/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:46:35.700412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53ad01-0f73-4ba8-a209-87cab2d5020d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:46:35.702585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ab53ad01-0f73-4ba8-a209-87cab2d5020d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:35.822997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab53ad01-0f73-4ba8-a209-87cab2d5020d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:46:35.828486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d42f9f-3cf7-42b4-bbe1-5688101e7291 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:46:35.829093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d42f9f-3cf7-42b4-bbe1-5688101e7291 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:35.829373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d42f9f-3cf7-42b4-bbe1-5688101e7291 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:35.829679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d42f9f-3cf7-42b4-bbe1-5688101e7291 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:35.839016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d42f9f-3cf7-42b4-bbe1-5688101e7291 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:46:35.840637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d42f9f-3cf7-42b4-bbe1-5688101e7291 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:46:35.849995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 765/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:46:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:46:36.926999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c42058-387d-4e16-b514-a6ffb9572088 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:36.927567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c42058-387d-4e16-b514-a6ffb9572088 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:36.927567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c42058-387d-4e16-b514-a6ffb9572088 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:36.928940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 749/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:46:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:46:36.934948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564a123-a31e-4b09-ad43-4b7818cd6516 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:36.935388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564a123-a31e-4b09-ad43-4b7818cd6516 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:36.935495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6564a123-a31e-4b09-ad43-4b7818cd6516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:36.954682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6564a123-a31e-4b09-ad43-4b7818cd6516 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:46:36.955861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6564a123-a31e-4b09-ad43-4b7818cd6516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:36.964457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 766/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:46:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:46:37.118771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c42058-387d-4e16-b514-a6ffb9572088 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:46:37.135294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c42058-387d-4e16-b514-a6ffb9572088 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:46:37.140964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bceb494e-90bf-4ff1-bdda-f5f06db24213 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:46:37.141613 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb494e-90bf-4ff1-bdda-f5f06db24213 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:37.142028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb494e-90bf-4ff1-bdda-f5f06db24213 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:37.142276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bceb494e-90bf-4ff1-bdda-f5f06db24213 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:37.151443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb494e-90bf-4ff1-bdda-f5f06db24213 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:46:37.153118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bceb494e-90bf-4ff1-bdda-f5f06db24213 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:46:37.163163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 750/1516] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:46:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:46:37.582555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194dbf6-43f8-4af8-99c5-4374604f3fb8 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:37.582839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194dbf6-43f8-4af8-99c5-4374604f3fb8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:37.583115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a194dbf6-43f8-4af8-99c5-4374604f3fb8 None None] PATH_INFO: `/v3` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:37.584396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 767/1517] 10.222.0.20 () {54 vars in 925 bytes} [Sat Sep 17 00:46:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:46:37.591148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b79c2-ab56-4e86-ab76-ad4a5df35873 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:37.591435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b79c2-ab56-4e86-ab76-ad4a5df35873 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:37.591711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b79c2-ab56-4e86-ab76-ad4a5df35873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:37.651242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-c54b79c2-ab56-4e86-ab76-ad4a5df35873 None None] MFA Rules not processed for user `47fef4612fbd4d00ad8de2a2144a2ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:46:37.652459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c54b79c2-ab56-4e86-ab76-ad4a5df35873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:37.668814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:46:37.723461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 751/1518] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Sep 17 00:46:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:46:41.271611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594094d-6ec9-4e48-9945-7ffadc6a8f08 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:41.272079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594094d-6ec9-4e48-9945-7ffadc6a8f08 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:41.272187 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8594094d-6ec9-4e48-9945-7ffadc6a8f08 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:41.274002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 768/1519] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 17 00:46:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:46:41.279027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350d72f-fb1c-4781-9136-283b585bbb7a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:41.279440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350d72f-fb1c-4781-9136-283b585bbb7a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:41.279587 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350d72f-fb1c-4781-9136-283b585bbb7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:41.299175 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9350d72f-fb1c-4781-9136-283b585bbb7a None None] MFA Rules not processed for user `47fef4612fbd4d00ad8de2a2144a2ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:46:41.300371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9350d72f-fb1c-4781-9136-283b585bbb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:41.308880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 752/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 17 00:46:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:46:41.316466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594094d-6ec9-4e48-9945-7ffadc6a8f08 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:46:41.329741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8594094d-6ec9-4e48-9945-7ffadc6a8f08 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:46:41.334609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2abd1-9f7f-4ba8-9b33-15d871e1d34b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:46:41.335680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2abd1-9f7f-4ba8-9b33-15d871e1d34b service placement] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:41.335957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2abd1-9f7f-4ba8-9b33-15d871e1d34b service placement] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:41.336223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2abd1-9f7f-4ba8-9b33-15d871e1d34b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:41.344654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2abd1-9f7f-4ba8-9b33-15d871e1d34b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:46:41.346347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2abd1-9f7f-4ba8-9b33-15d871e1d34b service placement] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:46:41.356571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 769/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:46:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:46:48.655208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90603b96-dd59-48d0-970e-5a0430f09c2e None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:48.655794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90603b96-dd59-48d0-970e-5a0430f09c2e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:48.655794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90603b96-dd59-48d0-970e-5a0430f09c2e None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:48.657005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 753/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:46:48.662980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009fa98-d33e-46da-8a74-2e13fa9c3785 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:48.663464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009fa98-d33e-46da-8a74-2e13fa9c3785 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:48.663572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5009fa98-d33e-46da-8a74-2e13fa9c3785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:48.684372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-5009fa98-d33e-46da-8a74-2e13fa9c3785 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:46:48.685602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5009fa98-d33e-46da-8a74-2e13fa9c3785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:48.693304 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 770/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:46:48.845513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90603b96-dd59-48d0-970e-5a0430f09c2e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:46:48.859943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90603b96-dd59-48d0-970e-5a0430f09c2e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:46:48.865244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374ffc68-5a29-4079-98d9-8e0fddba9c84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:46:48.865872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ffc68-5a29-4079-98d9-8e0fddba9c84 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:48.866149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ffc68-5a29-4079-98d9-8e0fddba9c84 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:48.866421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ffc68-5a29-4079-98d9-8e0fddba9c84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:48.874746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ffc68-5a29-4079-98d9-8e0fddba9c84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:46:48.876326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374ffc68-5a29-4079-98d9-8e0fddba9c84 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:46:48.886039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 754/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:46:49.948809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dcda1-7db0-4985-b1c2-159e03b6e3cd None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:49.949399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dcda1-7db0-4985-b1c2-159e03b6e3cd None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:49.949399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76dcda1-7db0-4985-b1c2-159e03b6e3cd None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:49.950873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 771/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 17 00:46:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:46:49.956927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439f62-cd9a-4917-9010-a2e32a48bcc6 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:49.957349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439f62-cd9a-4917-9010-a2e32a48bcc6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:49.957504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10439f62-cd9a-4917-9010-a2e32a48bcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:49.977550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-10439f62-cd9a-4917-9010-a2e32a48bcc6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:46:49.978734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-10439f62-cd9a-4917-9010-a2e32a48bcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:49.986503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 755/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 17 00:46:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:46:50.137839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dcda1-7db0-4985-b1c2-159e03b6e3cd None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:46:50.152146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76dcda1-7db0-4985-b1c2-159e03b6e3cd None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:46:50.157768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aabf12-c91c-4d67-ac7c-a028e38e63bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:46:50.158358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aabf12-c91c-4d67-ac7c-a028e38e63bf service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:50.158631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aabf12-c91c-4d67-ac7c-a028e38e63bf service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:50.158899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aabf12-c91c-4d67-ac7c-a028e38e63bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:50.166960 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aabf12-c91c-4d67-ac7c-a028e38e63bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:46:50.168518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aabf12-c91c-4d67-ac7c-a028e38e63bf service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:46:50.177588 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 772/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:46:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:46:54.101420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067e8c1-6867-4ba9-b0f5-b881a7041c74 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:54.101993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067e8c1-6867-4ba9-b0f5-b881a7041c74 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:54.101993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067e8c1-6867-4ba9-b0f5-b881a7041c74 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:54.103374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 756/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:46:54.111186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ee5f-ac03-485e-8929-cc2cc394a2b4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:54.111630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ee5f-ac03-485e-8929-cc2cc394a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:54.111738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c2ee5f-ac03-485e-8929-cc2cc394a2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:54.130694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-31c2ee5f-ac03-485e-8929-cc2cc394a2b4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:46:54.131867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-31c2ee5f-ac03-485e-8929-cc2cc394a2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:54.139525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 773/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:46:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:46:54.424475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067e8c1-6867-4ba9-b0f5-b881a7041c74 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:46:54.426305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8067e8c1-6867-4ba9-b0f5-b881a7041c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:54.505412 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067e8c1-6867-4ba9-b0f5-b881a7041c74 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:46:54.509026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03718e65-fc74-40c6-ade2-e4ff6dbd2dcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:46:54.509781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718e65-fc74-40c6-ade2-e4ff6dbd2dcc service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:54.510061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718e65-fc74-40c6-ade2-e4ff6dbd2dcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:54.510333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03718e65-fc74-40c6-ade2-e4ff6dbd2dcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:54.520222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03718e65-fc74-40c6-ade2-e4ff6dbd2dcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:46:54.522008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03718e65-fc74-40c6-ade2-e4ff6dbd2dcc service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:46:54.532253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 757/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:46:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:46:56.646898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794393bd-b250-49ff-a5a9-977e1f7d6b37 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:56.647434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794393bd-b250-49ff-a5a9-977e1f7d6b37 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:56.647434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794393bd-b250-49ff-a5a9-977e1f7d6b37 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:56.648744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 774/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:46:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:46:56.653996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e205810-525d-4a3e-818b-a1754dcd66fd None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:56.654463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e205810-525d-4a3e-818b-a1754dcd66fd None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:56.654580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e205810-525d-4a3e-818b-a1754dcd66fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:56.792242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0e205810-525d-4a3e-818b-a1754dcd66fd None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:46:56.793486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0e205810-525d-4a3e-818b-a1754dcd66fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:46:56.801368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 758/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:46:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:46:57.094742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794393bd-b250-49ff-a5a9-977e1f7d6b37 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:46:57.105982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794393bd-b250-49ff-a5a9-977e1f7d6b37 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:46:57.109473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c727886-d70b-4b61-bebe-130801ac5b8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:46:57.110064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c727886-d70b-4b61-bebe-130801ac5b8a service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:46:57.110338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c727886-d70b-4b61-bebe-130801ac5b8a service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:46:57.110607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c727886-d70b-4b61-bebe-130801ac5b8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:46:57.119218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c727886-d70b-4b61-bebe-130801ac5b8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:46:57.120633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c727886-d70b-4b61-bebe-130801ac5b8a service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:46:57.130970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 775/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:46:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:47:00.752217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10a18-a93d-479a-b5d5-5aab9f3c97dd None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:47:00.752748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10a18-a93d-479a-b5d5-5aab9f3c97dd None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:47:00.752857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad10a18-a93d-479a-b5d5-5aab9f3c97dd None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:47:00.754151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 759/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:47:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:47:00.759241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96b37-7046-4ad6-9478-65cd53aaed19 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:47:00.759635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96b37-7046-4ad6-9478-65cd53aaed19 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:47:00.759807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff96b37-7046-4ad6-9478-65cd53aaed19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:47:00.779559 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8ff96b37-7046-4ad6-9478-65cd53aaed19 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:47:00.780737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8ff96b37-7046-4ad6-9478-65cd53aaed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:47:00.788396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 776/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:47:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:47:01.088934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10a18-a93d-479a-b5d5-5aab9f3c97dd None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:47:01.090628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1ad10a18-a93d-479a-b5d5-5aab9f3c97dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:47:01.156966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:47:01.171020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad10a18-a93d-479a-b5d5-5aab9f3c97dd None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:47:01.174651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aea2be-70a2-4d79-8a2f-13ae793d895e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:47:01.175258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aea2be-70a2-4d79-8a2f-13ae793d895e service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:47:01.175534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aea2be-70a2-4d79-8a2f-13ae793d895e service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:47:01.175836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aea2be-70a2-4d79-8a2f-13ae793d895e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:47:01.184671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aea2be-70a2-4d79-8a2f-13ae793d895e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:47:01.186124 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aea2be-70a2-4d79-8a2f-13ae793d895e service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:47:01.195811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 760/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:47:03.332157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63956b2b-a55d-47fc-aea9-b31fca436607 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:47:03.332816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63956b2b-a55d-47fc-aea9-b31fca436607 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:47:03.332816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63956b2b-a55d-47fc-aea9-b31fca436607 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:47:03.334119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 777/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 17 00:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:47:03.340170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38144c-6080-4883-a5f8-80110ba1399c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:47:03.340605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38144c-6080-4883-a5f8-80110ba1399c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:47:03.340754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f38144c-6080-4883-a5f8-80110ba1399c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:47:03.359422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9f38144c-6080-4883-a5f8-80110ba1399c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:47:03.360585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9f38144c-6080-4883-a5f8-80110ba1399c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:47:03.368141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 761/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 17 00:47:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:47:03.670548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63956b2b-a55d-47fc-aea9-b31fca436607 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:47:03.672222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-63956b2b-a55d-47fc-aea9-b31fca436607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:47:03.685594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63956b2b-a55d-47fc-aea9-b31fca436607 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:47:03.689050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208fd3bf-ac65-4d66-bd08-48b3885a89e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:47:03.689678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd3bf-ac65-4d66-bd08-48b3885a89e0 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:47:03.689959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd3bf-ac65-4d66-bd08-48b3885a89e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:47:03.690232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208fd3bf-ac65-4d66-bd08-48b3885a89e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:47:03.699522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fd3bf-ac65-4d66-bd08-48b3885a89e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:47:03.700961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208fd3bf-ac65-4d66-bd08-48b3885a89e0 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:47:03.710048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 778/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:47:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:47:13.354639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=11 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:47:13.706119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:28.861655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad3130-5ddb-46b7-b8bd-85b964fd59fe None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:28.862338 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad3130-5ddb-46b7-b8bd-85b964fd59fe None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:28.862455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bad3130-5ddb-46b7-b8bd-85b964fd59fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:28.902540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-1bad3130-5ddb-46b7-b8bd-85b964fd59fe None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:28.903792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1bad3130-5ddb-46b7-b8bd-85b964fd59fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:28.913370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 762/1540] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:28.922774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20e4e-9b6b-4471-a329-47a590b7a80d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:28.923414 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20e4e-9b6b-4471-a329-47a590b7a80d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:28.923414 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b20e4e-9b6b-4471-a329-47a590b7a80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:28.951203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-71b20e4e-9b6b-4471-a329-47a590b7a80d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:28.952415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-71b20e4e-9b6b-4471-a329-47a590b7a80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:28.961459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 779/1541] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:28.966638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad3130-5ddb-46b7-b8bd-85b964fd59fe None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:28.982747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bad3130-5ddb-46b7-b8bd-85b964fd59fe None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:28.990931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a873-c2e1-4efe-83b8-a0596f600bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:28.991576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a873-c2e1-4efe-83b8-a0596f600bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:28.991855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a873-c2e1-4efe-83b8-a0596f600bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:28.992126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a873-c2e1-4efe-83b8-a0596f600bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:28.992803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a873-c2e1-4efe-83b8-a0596f600bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:28.993108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a873-c2e1-4efe-83b8-a0596f600bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:28.994834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a873-c2e1-4efe-83b8-a0596f600bd5 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.007996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 763/1542] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:29.017770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20e4e-9b6b-4471-a329-47a590b7a80d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.031158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b20e4e-9b6b-4471-a329-47a590b7a80d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.038934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65da80-195d-47da-a027-32462a759cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.039568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65da80-195d-47da-a027-32462a759cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.039854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65da80-195d-47da-a027-32462a759cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.040128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65da80-195d-47da-a027-32462a759cd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.040788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65da80-195d-47da-a027-32462a759cd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.042867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d65da80-195d-47da-a027-32462a759cd5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.051553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e74f-69a0-4470-bea9-16dad490d015 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.052469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e74f-69a0-4470-bea9-16dad490d015 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.052665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b2e74f-69a0-4470-bea9-16dad490d015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.086673 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a2b2e74f-69a0-4470-bea9-16dad490d015 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.088198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a2b2e74f-69a0-4470-bea9-16dad490d015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.108557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 764/1543] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.117269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 780/1544] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:48:29.118857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92053e-d5af-4503-ba09-6ad081fe2782 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.119145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92053e-d5af-4503-ba09-6ad081fe2782 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.119422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d92053e-d5af-4503-ba09-6ad081fe2782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.121565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65da80-195d-47da-a027-32462a759cd5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.152147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9d92053e-d5af-4503-ba09-6ad081fe2782 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.153392 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9d92053e-d5af-4503-ba09-6ad081fe2782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.250143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 765/1545] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:29.253717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65da80-195d-47da-a027-32462a759cd5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.254762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92053e-d5af-4503-ba09-6ad081fe2782 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.269198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61801b-c174-4e89-aea1-e279290fbff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.269873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61801b-c174-4e89-aea1-e279290fbff1 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.270506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61801b-c174-4e89-aea1-e279290fbff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.270749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d92053e-d5af-4503-ba09-6ad081fe2782 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.270874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61801b-c174-4e89-aea1-e279290fbff1 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.271493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61801b-c174-4e89-aea1-e279290fbff1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.272529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WARNING py.warnings [None req-0c61801b-c174-4e89-aea1-e279290fbff1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:48:29.272529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: warnings.warn(msg) Sep 17 00:48:29.272529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: Sep 17 00:48:29.273823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c61801b-c174-4e89-aea1-e279290fbff1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.281627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe31526-7a3e-4558-acdc-3f45598e93c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.282261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31526-7a3e-4558-acdc-3f45598e93c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.282544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31526-7a3e-4558-acdc-3f45598e93c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.282817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe31526-7a3e-4558-acdc-3f45598e93c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.283474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31526-7a3e-4558-acdc-3f45598e93c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:29.283778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31526-7a3e-4558-acdc-3f45598e93c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.285392 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe31526-7a3e-4558-acdc-3f45598e93c2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.304579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 766/1546] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:29.305986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0887b19-708d-4697-923e-33e50cd0f1f1 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.306306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0887b19-708d-4697-923e-33e50cd0f1f1 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.306609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0887b19-708d-4697-923e-33e50cd0f1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.318590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 781/1547] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:29.325114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61801b-c174-4e89-aea1-e279290fbff1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.333531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e0887b19-708d-4697-923e-33e50cd0f1f1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.335109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e0887b19-708d-4697-923e-33e50cd0f1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.339951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61801b-c174-4e89-aea1-e279290fbff1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.349535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e443e7-de67-4ea4-9cad-1e476131fcd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.350229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e443e7-de67-4ea4-9cad-1e476131fcd7 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.350499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e443e7-de67-4ea4-9cad-1e476131fcd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.350775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e443e7-de67-4ea4-9cad-1e476131fcd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.351468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e443e7-de67-4ea4-9cad-1e476131fcd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.353539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 767/1548] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.355329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0887b19-708d-4697-923e-33e50cd0f1f1 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.356857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e443e7-de67-4ea4-9cad-1e476131fcd7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.379692 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0887b19-708d-4697-923e-33e50cd0f1f1 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.385497 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 782/1549] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:29.386886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4d75e-352b-4180-9285-1abbd00c3473 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.387178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4d75e-352b-4180-9285-1abbd00c3473 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.387455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf4d75e-352b-4180-9285-1abbd00c3473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.390788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0de3f08-6944-473d-9622-e83c2c0e30cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.392021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3f08-6944-473d-9622-e83c2c0e30cf admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.392521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3f08-6944-473d-9622-e83c2c0e30cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.393007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0de3f08-6944-473d-9622-e83c2c0e30cf admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.394139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3f08-6944-473d-9622-e83c2c0e30cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.395475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING py.warnings [None req-f0de3f08-6944-473d-9622-e83c2c0e30cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:48:29.395475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: warnings.warn(msg) Sep 17 00:48:29.395475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: Sep 17 00:48:29.397089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0de3f08-6944-473d-9622-e83c2c0e30cf admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.430270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-faf4d75e-352b-4180-9285-1abbd00c3473 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.431610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-faf4d75e-352b-4180-9285-1abbd00c3473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.458098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 783/1550] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.459227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4d75e-352b-4180-9285-1abbd00c3473 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.463300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 768/1551] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/projects => generated 389 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:29.464816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885c4e5-dc62-4ef8-8118-20d57980fa9b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.465100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885c4e5-dc62-4ef8-8118-20d57980fa9b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.465370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885c4e5-dc62-4ef8-8118-20d57980fa9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.483643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf4d75e-352b-4180-9285-1abbd00c3473 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.490495 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-6885c4e5-dc62-4ef8-8118-20d57980fa9b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.491779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-6885c4e5-dc62-4ef8-8118-20d57980fa9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.575071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ffc45-2fbf-490e-a94a-0c83a45c8474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.575699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ffc45-2fbf-490e-a94a-0c83a45c8474 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.575979 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ffc45-2fbf-490e-a94a-0c83a45c8474 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.576253 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ffc45-2fbf-490e-a94a-0c83a45c8474 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.576912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ffc45-2fbf-490e-a94a-0c83a45c8474 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.578532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ffc45-2fbf-490e-a94a-0c83a45c8474 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.579865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 769/1552] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.581382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885c4e5-dc62-4ef8-8118-20d57980fa9b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.594118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 784/1553] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:29.594118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657737c-2477-4c3d-8ef5-d4891154888d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.594118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657737c-2477-4c3d-8ef5-d4891154888d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.594118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d657737c-2477-4c3d-8ef5-d4891154888d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.594602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885c4e5-dc62-4ef8-8118-20d57980fa9b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.601488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54808bd5-edf4-4284-b2b1-322c5677eecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.602107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54808bd5-edf4-4284-b2b1-322c5677eecb admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.602388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54808bd5-edf4-4284-b2b1-322c5677eecb admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.602671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54808bd5-edf4-4284-b2b1-322c5677eecb admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.603313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54808bd5-edf4-4284-b2b1-322c5677eecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.605254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54808bd5-edf4-4284-b2b1-322c5677eecb admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.613766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d657737c-2477-4c3d-8ef5-d4891154888d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.615587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d657737c-2477-4c3d-8ef5-d4891154888d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.625069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 785/1554] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.625981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657737c-2477-4c3d-8ef5-d4891154888d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.636143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 770/1555] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/users => generated 295 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:29.637388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fde0d7-f643-4d23-afce-54cdd9f0471f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.637551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d657737c-2477-4c3d-8ef5-d4891154888d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.637817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fde0d7-f643-4d23-afce-54cdd9f0471f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.638107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fde0d7-f643-4d23-afce-54cdd9f0471f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.642412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03498b3b-50e8-4823-8a5b-536c7a8e19b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.643095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498b3b-50e8-4823-8a5b-536c7a8e19b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.643371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498b3b-50e8-4823-8a5b-536c7a8e19b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.643663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03498b3b-50e8-4823-8a5b-536c7a8e19b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.644306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03498b3b-50e8-4823-8a5b-536c7a8e19b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:29.644604 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03498b3b-50e8-4823-8a5b-536c7a8e19b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.645681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WARNING py.warnings [None req-03498b3b-50e8-4823-8a5b-536c7a8e19b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:48:29.645681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: warnings.warn(msg) Sep 17 00:48:29.645681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: Sep 17 00:48:29.646984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03498b3b-50e8-4823-8a5b-536c7a8e19b1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.658490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-57fde0d7-f643-4d23-afce-54cdd9f0471f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.658850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 786/1556] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:29.666623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-57fde0d7-f643-4d23-afce-54cdd9f0471f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.666744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8877e-62a8-4411-9da9-5ec8ca8e7837 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.666744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8877e-62a8-4411-9da9-5ec8ca8e7837 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.666744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8877e-62a8-4411-9da9-5ec8ca8e7837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.669364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 771/1557] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.670795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee17a-f4fc-4a51-af4c-5a52e817c312 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.671074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee17a-f4fc-4a51-af4c-5a52e817c312 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.671353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dee17a-f4fc-4a51-af4c-5a52e817c312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.682318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-53b8877e-62a8-4411-9da9-5ec8ca8e7837 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.683509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-53b8877e-62a8-4411-9da9-5ec8ca8e7837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.690873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-94dee17a-f4fc-4a51-af4c-5a52e817c312 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.691390 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 787/1558] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.692033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-94dee17a-f4fc-4a51-af4c-5a52e817c312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.692216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8877e-62a8-4411-9da9-5ec8ca8e7837 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.698781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:29.700348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 772/1559] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.701618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6945dc-088b-4525-9044-31c3b93c45d4 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.701904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6945dc-088b-4525-9044-31c3b93c45d4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.702177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6945dc-088b-4525-9044-31c3b93c45d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.702509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8877e-62a8-4411-9da9-5ec8ca8e7837 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.708372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3a186-4905-4c7d-9c14-f48369d001d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.709599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:29.709743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3a186-4905-4c7d-9c14-f48369d001d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.709898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3a186-4905-4c7d-9c14-f48369d001d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.710162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3a186-4905-4c7d-9c14-f48369d001d0 admin admin] PATH_INFO: `/v3/projects/1e9d2a334cbb47329690f1bcb260cc25/users/8075a4a532e647949f38a1f928cb9caf/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.723157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3e6945dc-088b-4525-9044-31c3b93c45d4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.724875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3e6945dc-088b-4525-9044-31c3b93c45d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.725324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3a186-4905-4c7d-9c14-f48369d001d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9d2a334cbb47329690f1bcb260cc25, user_id=8075a4a532e647949f38a1f928cb9caf, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.727998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3a186-4905-4c7d-9c14-f48369d001d0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.733018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 773/1560] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.736376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c4df-2efc-42c9-bbae-3f48fa85498a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.736662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c4df-2efc-42c9-bbae-3f48fa85498a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.736936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190c4df-2efc-42c9-bbae-3f48fa85498a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.747249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 788/1561] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:29 2022] PUT /identity/v3/projects/1e9d2a334cbb47329690f1bcb260cc25/users/8075a4a532e647949f38a1f928cb9caf/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:29.748404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3a186-4905-4c7d-9c14-f48369d001d0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.756502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d190c4df-2efc-42c9-bbae-3f48fa85498a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.757801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d190c4df-2efc-42c9-bbae-3f48fa85498a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.815375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3a186-4905-4c7d-9c14-f48369d001d0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.816888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 774/1562] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.817794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190c4df-2efc-42c9-bbae-3f48fa85498a None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.820544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0aba3a-46d7-4690-9e60-01ebfdedf853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.821218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aba3a-46d7-4690-9e60-01ebfdedf853 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.821534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aba3a-46d7-4690-9e60-01ebfdedf853 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.821807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0aba3a-46d7-4690-9e60-01ebfdedf853 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.822446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aba3a-46d7-4690-9e60-01ebfdedf853 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.824038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0aba3a-46d7-4690-9e60-01ebfdedf853 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.829616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190c4df-2efc-42c9-bbae-3f48fa85498a None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.834632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfb4af-5d64-49d4-bbbb-c2b506720737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.834837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 789/1563] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:29.835986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb4af-5d64-49d4-bbbb-c2b506720737 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.836262 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb4af-5d64-49d4-bbbb-c2b506720737 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.836535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bfb4af-5d64-49d4-bbbb-c2b506720737 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.836809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3385303-7118-4b8d-8c5b-b70c6f82580e None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.837438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfb4af-5d64-49d4-bbbb-c2b506720737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.837541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3385303-7118-4b8d-8c5b-b70c6f82580e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.837915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3385303-7118-4b8d-8c5b-b70c6f82580e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.839409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bfb4af-5d64-49d4-bbbb-c2b506720737 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.863658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a3385303-7118-4b8d-8c5b-b70c6f82580e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.865546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a3385303-7118-4b8d-8c5b-b70c6f82580e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.875681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 790/1564] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.879533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 775/1565] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/projects => generated 393 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:29.880015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee19de-e57f-4520-8961-69a088d5480b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.880015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee19de-e57f-4520-8961-69a088d5480b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.880207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfb4af-5d64-49d4-bbbb-c2b506720737 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:29.880292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee19de-e57f-4520-8961-69a088d5480b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.898904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-36ee19de-e57f-4520-8961-69a088d5480b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.900114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-36ee19de-e57f-4520-8961-69a088d5480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.943089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bfb4af-5d64-49d4-bbbb-c2b506720737 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:29.948064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef65648-cccb-416b-b76f-cd1d076787c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:29.948666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef65648-cccb-416b-b76f-cd1d076787c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.948948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef65648-cccb-416b-b76f-cd1d076787c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.949228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef65648-cccb-416b-b76f-cd1d076787c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.949927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef65648-cccb-416b-b76f-cd1d076787c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:29.950230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef65648-cccb-416b-b76f-cd1d076787c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:29.951836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef65648-cccb-416b-b76f-cd1d076787c0 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:29.960252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 791/1566] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.961521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa88f8-f773-46b3-b52f-e0b696271d61 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.961812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa88f8-f773-46b3-b52f-e0b696271d61 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.962356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa88f8-f773-46b3-b52f-e0b696271d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.965333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 776/1567] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:29.966606 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0b18-1af9-408f-9ed9-48dc9c2622ab None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:29.966892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0b18-1af9-408f-9ed9-48dc9c2622ab None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:29.967165 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee0b18-1af9-408f-9ed9-48dc9c2622ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:29.988359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-5baa88f8-f773-46b3-b52f-e0b696271d61 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.989604 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5baa88f8-f773-46b3-b52f-e0b696271d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:29.996728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-88ee0b18-1af9-408f-9ed9-48dc9c2622ab None None] MFA Rules not processed for user `8075a4a532e647949f38a1f928cb9caf`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:29.997378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 792/1568] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:29.997935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-88ee0b18-1af9-408f-9ed9-48dc9c2622ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:30.001833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa88f8-f773-46b3-b52f-e0b696271d61 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.010827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa88f8-f773-46b3-b52f-e0b696271d61 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.015478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679deabf-dc10-459c-849b-f2b0218e1b35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.016054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679deabf-dc10-459c-849b-f2b0218e1b35 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.016328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679deabf-dc10-459c-849b-f2b0218e1b35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.016600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679deabf-dc10-459c-849b-f2b0218e1b35 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.017234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679deabf-dc10-459c-849b-f2b0218e1b35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:30.017571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679deabf-dc10-459c-849b-f2b0218e1b35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.019144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679deabf-dc10-459c-849b-f2b0218e1b35 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.031128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 793/1569] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:30.031920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679deabf-dc10-459c-849b-f2b0218e1b35 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.042530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679deabf-dc10-459c-849b-f2b0218e1b35 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.047160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c15cc-7543-41bf-8215-40b32d9c941c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.047729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c15cc-7543-41bf-8215-40b32d9c941c admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.048006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c15cc-7543-41bf-8215-40b32d9c941c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.048277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4c15cc-7543-41bf-8215-40b32d9c941c admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.048907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c15cc-7543-41bf-8215-40b32d9c941c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.050580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4c15cc-7543-41bf-8215-40b32d9c941c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.057919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:30.062153 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 794/1570] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:30.063030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c15cc-7543-41bf-8215-40b32d9c941c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.064389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 777/1571] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:30.065333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee0b18-1af9-408f-9ed9-48dc9c2622ab None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.074341 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4c15cc-7543-41bf-8215-40b32d9c941c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.076018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ee0b18-1af9-408f-9ed9-48dc9c2622ab None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.079035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a5c42-ff99-42bc-8f29-709bd815763d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.079618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a5c42-ff99-42bc-8f29-709bd815763d admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.079888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a5c42-ff99-42bc-8f29-709bd815763d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.080161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a5c42-ff99-42bc-8f29-709bd815763d admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.080586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81b76a-47f7-481c-a4ae-905aa93cecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.080785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a5c42-ff99-42bc-8f29-709bd815763d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:30.081084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a5c42-ff99-42bc-8f29-709bd815763d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.081198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b76a-47f7-481c-a4ae-905aa93cecd1 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.081485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b76a-47f7-481c-a4ae-905aa93cecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.081890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b81b76a-47f7-481c-a4ae-905aa93cecd1 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.082384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81b76a-47f7-481c-a4ae-905aa93cecd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.082707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a5c42-ff99-42bc-8f29-709bd815763d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.084816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b81b76a-47f7-481c-a4ae-905aa93cecd1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.098289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 795/1572] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:30.099756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a5c42-ff99-42bc-8f29-709bd815763d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.111879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a5c42-ff99-42bc-8f29-709bd815763d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.117037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 778/1573] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.117037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81b76a-47f7-481c-a4ae-905aa93cecd1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.117270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191ad5d-c238-4177-a50a-647ac86338c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.118045 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191ad5d-c238-4177-a50a-647ac86338c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.118296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191ad5d-c238-4177-a50a-647ac86338c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.118558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191ad5d-c238-4177-a50a-647ac86338c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.119205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191ad5d-c238-4177-a50a-647ac86338c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:30.119504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191ad5d-c238-4177-a50a-647ac86338c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.121930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191ad5d-c238-4177-a50a-647ac86338c2 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.124594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b81b76a-47f7-481c-a4ae-905aa93cecd1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.129146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071efa13-4075-48b8-8670-4e0479a33ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.129761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071efa13-4075-48b8-8670-4e0479a33ff6 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.130073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071efa13-4075-48b8-8670-4e0479a33ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.130351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071efa13-4075-48b8-8670-4e0479a33ff6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.130968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071efa13-4075-48b8-8670-4e0479a33ff6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.132859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071efa13-4075-48b8-8670-4e0479a33ff6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.134647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 796/1574] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:30.135318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191ad5d-c238-4177-a50a-647ac86338c2 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.147116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191ad5d-c238-4177-a50a-647ac86338c2 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.152288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498340-b1a1-48a0-871e-c1f3fba870a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.152862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498340-b1a1-48a0-871e-c1f3fba870a0 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.153161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498340-b1a1-48a0-871e-c1f3fba870a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.153477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498340-b1a1-48a0-871e-c1f3fba870a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.154121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498340-b1a1-48a0-871e-c1f3fba870a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:30.154458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498340-b1a1-48a0-871e-c1f3fba870a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.156619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498340-b1a1-48a0-871e-c1f3fba870a0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.166690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 779/1575] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.166690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071efa13-4075-48b8-8670-4e0479a33ff6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.171621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:30.177347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 797/1576] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:30.178083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498340-b1a1-48a0-871e-c1f3fba870a0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.195782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498340-b1a1-48a0-871e-c1f3fba870a0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.230185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071efa13-4075-48b8-8670-4e0479a33ff6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.234763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac133e36-6da8-476f-8c03-8c137b573a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.235367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac133e36-6da8-476f-8c03-8c137b573a2e admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.235642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac133e36-6da8-476f-8c03-8c137b573a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.235915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac133e36-6da8-476f-8c03-8c137b573a2e admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.236539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac133e36-6da8-476f-8c03-8c137b573a2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.238469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac133e36-6da8-476f-8c03-8c137b573a2e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.252449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da722997-ab0b-4ab9-bd07-2c56ff3a5fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.253110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da722997-ab0b-4ab9-bd07-2c56ff3a5fd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.253393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da722997-ab0b-4ab9-bd07-2c56ff3a5fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.253692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da722997-ab0b-4ab9-bd07-2c56ff3a5fd7 admin admin] PATH_INFO: `/v3/projects/284b351f38d94be79f4625dd7026da79/users/fc89c54d75e14107b79c30cabdb91ae1/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.268496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 780/1577] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.268496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de4a4-5aa2-4836-bada-e01233cfc560 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.268496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de4a4-5aa2-4836-bada-e01233cfc560 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.268496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581de4a4-5aa2-4836-bada-e01233cfc560 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.269313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 781/1578] 10.222.0.16 () {54 vars in 965 bytes} [Sat Sep 17 00:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:48:30.269541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da722997-ab0b-4ab9-bd07-2c56ff3a5fd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=284b351f38d94be79f4625dd7026da79, user_id=fc89c54d75e14107b79c30cabdb91ae1, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.269713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de4a4-5aa2-4836-bada-e01233cfc560 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.272933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da722997-ab0b-4ab9-bd07-2c56ff3a5fd7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.286739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 798/1579] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:30 2022] PUT /identity/v3/projects/284b351f38d94be79f4625dd7026da79/users/fc89c54d75e14107b79c30cabdb91ae1/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:30.287660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da722997-ab0b-4ab9-bd07-2c56ff3a5fd7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.335380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581de4a4-5aa2-4836-bada-e01233cfc560 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.348914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da722997-ab0b-4ab9-bd07-2c56ff3a5fd7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.353728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ad88b-5449-4f11-92ac-d3698ed0f959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.354334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ad88b-5449-4f11-92ac-d3698ed0f959 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.354619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ad88b-5449-4f11-92ac-d3698ed0f959 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.354896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ad88b-5449-4f11-92ac-d3698ed0f959 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.355542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ad88b-5449-4f11-92ac-d3698ed0f959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.357147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ad88b-5449-4f11-92ac-d3698ed0f959 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.370182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 799/1580] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:30.370182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ad88b-5449-4f11-92ac-d3698ed0f959 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.377510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ad88b-5449-4f11-92ac-d3698ed0f959 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.382729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618958de-a0b2-460a-8c19-babf287a81ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.383307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618958de-a0b2-460a-8c19-babf287a81ab admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.383592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618958de-a0b2-460a-8c19-babf287a81ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.383859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618958de-a0b2-460a-8c19-babf287a81ab admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.384479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618958de-a0b2-460a-8c19-babf287a81ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.386401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618958de-a0b2-460a-8c19-babf287a81ab admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.387249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:30.398567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0f23b-657c-419b-87f5-31ce7fb9e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.399207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0f23b-657c-419b-87f5-31ce7fb9e72f admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.399481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0f23b-657c-419b-87f5-31ce7fb9e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.399869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f0f23b-657c-419b-87f5-31ce7fb9e72f admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.400504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0f23b-657c-419b-87f5-31ce7fb9e72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.402517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f0f23b-657c-419b-87f5-31ce7fb9e72f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.416570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 800/1581] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.417824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618958de-a0b2-460a-8c19-babf287a81ab admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.435907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 782/1582] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.436812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0f23b-657c-419b-87f5-31ce7fb9e72f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.479595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:30.484395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618958de-a0b2-460a-8c19-babf287a81ab admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.501809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f0f23b-657c-419b-87f5-31ce7fb9e72f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.506891 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895733d-a0ed-4eea-94ef-48a15924e7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.507495 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895733d-a0ed-4eea-94ef-48a15924e7ee admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.507769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895733d-a0ed-4eea-94ef-48a15924e7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.508037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9895733d-a0ed-4eea-94ef-48a15924e7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.508662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895733d-a0ed-4eea-94ef-48a15924e7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.510607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9895733d-a0ed-4eea-94ef-48a15924e7ee admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.537464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 783/1583] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.538252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895733d-a0ed-4eea-94ef-48a15924e7ee admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.545105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b54f9-2bae-4422-ac6e-865204afb9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.545905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b54f9-2bae-4422-ac6e-865204afb9cd admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.546186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b54f9-2bae-4422-ac6e-865204afb9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.546463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b54f9-2bae-4422-ac6e-865204afb9cd admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.547096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b54f9-2bae-4422-ac6e-865204afb9cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.549004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b54f9-2bae-4422-ac6e-865204afb9cd admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.573882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 801/1584] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/users => generated 289 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.573882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652077-2be0-46b1-83d9-b4bda2f8f022 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.573882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652077-2be0-46b1-83d9-b4bda2f8f022 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.573882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8652077-2be0-46b1-83d9-b4bda2f8f022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.605059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9895733d-a0ed-4eea-94ef-48a15924e7ee admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.609814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bcfab-af33-46a0-8757-986b5d0b47aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.610419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bcfab-af33-46a0-8757-986b5d0b47aa admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.610609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a8652077-2be0-46b1-83d9-b4bda2f8f022 None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:30.610714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bcfab-af33-46a0-8757-986b5d0b47aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.610953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bcfab-af33-46a0-8757-986b5d0b47aa admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.611606 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bcfab-af33-46a0-8757-986b5d0b47aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.611817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a8652077-2be0-46b1-83d9-b4bda2f8f022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:30.613571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bcfab-af33-46a0-8757-986b5d0b47aa admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.635986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 784/1585] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.637105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530161e2-aa49-4c59-a183-0df39b595c92 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.637391 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530161e2-aa49-4c59-a183-0df39b595c92 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.637693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530161e2-aa49-4c59-a183-0df39b595c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.657325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-530161e2-aa49-4c59-a183-0df39b595c92 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:30.658796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-530161e2-aa49-4c59-a183-0df39b595c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:30.666379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 785/1586] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:30.667333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530161e2-aa49-4c59-a183-0df39b595c92 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.676761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530161e2-aa49-4c59-a183-0df39b595c92 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.681794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55234e98-2bd6-4e4e-a159-fde10b275a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.682250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 802/1587] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:30.682435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55234e98-2bd6-4e4e-a159-fde10b275a24 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.682722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55234e98-2bd6-4e4e-a159-fde10b275a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.683002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55234e98-2bd6-4e4e-a159-fde10b275a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.683114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652077-2be0-46b1-83d9-b4bda2f8f022 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.683686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55234e98-2bd6-4e4e-a159-fde10b275a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.685297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55234e98-2bd6-4e4e-a159-fde10b275a24 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.695478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8652077-2be0-46b1-83d9-b4bda2f8f022 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.699277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 786/1588] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:30.699277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55234e98-2bd6-4e4e-a159-fde10b275a24 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.703158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4cad7-aa4b-4d97-b252-15b6e82336ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.703759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4cad7-aa4b-4d97-b252-15b6e82336ef admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.704039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4cad7-aa4b-4d97-b252-15b6e82336ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.704312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4cad7-aa4b-4d97-b252-15b6e82336ef admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.704942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4cad7-aa4b-4d97-b252-15b6e82336ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.706375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55234e98-2bd6-4e4e-a159-fde10b275a24 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.706981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a4cad7-aa4b-4d97-b252-15b6e82336ef admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.710905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f5f2-cc28-4e5a-bf73-6d236a7cd405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.711471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f5f2-cc28-4e5a-bf73-6d236a7cd405 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.711749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f5f2-cc28-4e5a-bf73-6d236a7cd405 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.712279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5f5f2-cc28-4e5a-bf73-6d236a7cd405 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.712891 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5f5f2-cc28-4e5a-bf73-6d236a7cd405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.714816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5f5f2-cc28-4e5a-bf73-6d236a7cd405 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.728668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 803/1589] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/users => generated 294 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.729485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4cad7-aa4b-4d97-b252-15b6e82336ef admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.737647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 787/1590] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/users => generated 293 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.738510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f5f2-cc28-4e5a-bf73-6d236a7cd405 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.739000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4cad7-aa4b-4d97-b252-15b6e82336ef admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.744245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fea7e6-b74a-4c24-a5e9-0c4ac1dd0ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.744843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fea7e6-b74a-4c24-a5e9-0c4ac1dd0ddc admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.745121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fea7e6-b74a-4c24-a5e9-0c4ac1dd0ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.745396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fea7e6-b74a-4c24-a5e9-0c4ac1dd0ddc admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.746051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fea7e6-b74a-4c24-a5e9-0c4ac1dd0ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.747969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fea7e6-b74a-4c24-a5e9-0c4ac1dd0ddc admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.749033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5f5f2-cc28-4e5a-bf73-6d236a7cd405 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.753567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a050d-6b04-4149-b17c-04726b635e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.754149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a050d-6b04-4149-b17c-04726b635e04 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.754425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a050d-6b04-4149-b17c-04726b635e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.754692 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89a050d-6b04-4149-b17c-04726b635e04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.755877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a050d-6b04-4149-b17c-04726b635e04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.757472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89a050d-6b04-4149-b17c-04726b635e04 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.768347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 788/1591] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:30.769139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a050d-6b04-4149-b17c-04726b635e04 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.771345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 804/1592] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:30 2022] POST /identity/v3/users => generated 293 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:30.772075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fea7e6-b74a-4c24-a5e9-0c4ac1dd0ddc admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.777569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:30.781490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89a050d-6b04-4149-b17c-04726b635e04 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.787524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b3d32-80fe-4305-8311-610e267c2869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.788111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b3d32-80fe-4305-8311-610e267c2869 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.788384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b3d32-80fe-4305-8311-610e267c2869 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.788650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b3d32-80fe-4305-8311-610e267c2869 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.789277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b3d32-80fe-4305-8311-610e267c2869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.790914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b3d32-80fe-4305-8311-610e267c2869 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.800667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 789/1593] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:30.801364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b3d32-80fe-4305-8311-610e267c2869 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.814317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b3d32-80fe-4305-8311-610e267c2869 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.815114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:30.821468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762b35b-6179-4705-bf3a-046f5c70bb1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.822062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762b35b-6179-4705-bf3a-046f5c70bb1d service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.822339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762b35b-6179-4705-bf3a-046f5c70bb1d service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.822610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762b35b-6179-4705-bf3a-046f5c70bb1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.830063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fea7e6-b74a-4c24-a5e9-0c4ac1dd0ddc admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.833810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4efe8-f678-4f4b-ae07-b040e9343ecd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.834408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4efe8-f678-4f4b-ae07-b040e9343ecd service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.834684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4efe8-f678-4f4b-ae07-b040e9343ecd service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.834955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4efe8-f678-4f4b-ae07-b040e9343ecd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.844269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4efe8-f678-4f4b-ae07-b040e9343ecd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.845739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4efe8-f678-4f4b-ae07-b040e9343ecd service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.855246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 805/1594] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:30.858262 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4efe8-f678-4f4b-ae07-b040e9343ecd service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.870915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4efe8-f678-4f4b-ae07-b040e9343ecd service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.877643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08acbf-8e5c-4981-8c92-979e4ecf27e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.878699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08acbf-8e5c-4981-8c92-979e4ecf27e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.879002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762b35b-6179-4705-bf3a-046f5c70bb1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.879165 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08acbf-8e5c-4981-8c92-979e4ecf27e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.879499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08acbf-8e5c-4981-8c92-979e4ecf27e6 admin admin] PATH_INFO: `/v3/projects/3ba7e7c6841c492581d7d22fb8905dfb/users/aac4f2beca334a7f8c62924b5d7e4fe5/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.885640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762b35b-6179-4705-bf3a-046f5c70bb1d service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.895651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08acbf-8e5c-4981-8c92-979e4ecf27e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ba7e7c6841c492581d7d22fb8905dfb, user_id=aac4f2beca334a7f8c62924b5d7e4fe5, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.896857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 790/1595] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:30.897815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762b35b-6179-4705-bf3a-046f5c70bb1d service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.898497 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f08acbf-8e5c-4981-8c92-979e4ecf27e6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.908544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762b35b-6179-4705-bf3a-046f5c70bb1d service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:30.915752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 806/1596] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:30 2022] PUT /identity/v3/projects/3ba7e7c6841c492581d7d22fb8905dfb/users/aac4f2beca334a7f8c62924b5d7e4fe5/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:30.916658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08acbf-8e5c-4981-8c92-979e4ecf27e6 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:30.981228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ec018-37ce-4b71-a508-84dac03eadc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:30.982153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ec018-37ce-4b71-a508-84dac03eadc3 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:30.982533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ec018-37ce-4b71-a508-84dac03eadc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:30.982901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ec018-37ce-4b71-a508-84dac03eadc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:30.984260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ec018-37ce-4b71-a508-84dac03eadc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:30.986963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ec018-37ce-4b71-a508-84dac03eadc3 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:30.999211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08acbf-8e5c-4981-8c92-979e4ecf27e6 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.003086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 791/1597] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:31.003086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ec018-37ce-4b71-a508-84dac03eadc3 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.007652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaae52d-25f1-455a-969a-ebb0f14bb009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.008528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaae52d-25f1-455a-969a-ebb0f14bb009 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.008939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaae52d-25f1-455a-969a-ebb0f14bb009 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.009366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaae52d-25f1-455a-969a-ebb0f14bb009 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.010106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaae52d-25f1-455a-969a-ebb0f14bb009 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.012039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaae52d-25f1-455a-969a-ebb0f14bb009 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.015347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ec018-37ce-4b71-a508-84dac03eadc3 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.021577 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397063b9-30da-4fd6-9029-f2a34a2b4816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.022619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397063b9-30da-4fd6-9029-f2a34a2b4816 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.023105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397063b9-30da-4fd6-9029-f2a34a2b4816 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.023568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397063b9-30da-4fd6-9029-f2a34a2b4816 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.024240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 807/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:30 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:31.024725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397063b9-30da-4fd6-9029-f2a34a2b4816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.025216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaae52d-25f1-455a-969a-ebb0f14bb009 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.026898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397063b9-30da-4fd6-9029-f2a34a2b4816 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.038092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 792/1599] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:31.038772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaae52d-25f1-455a-969a-ebb0f14bb009 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.039432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397063b9-30da-4fd6-9029-f2a34a2b4816 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.047259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2557edb1-39e6-41f6-a20b-4d223d4dce85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.048265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557edb1-39e6-41f6-a20b-4d223d4dce85 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.048641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557edb1-39e6-41f6-a20b-4d223d4dce85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.049212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2557edb1-39e6-41f6-a20b-4d223d4dce85 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.049982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557edb1-39e6-41f6-a20b-4d223d4dce85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.052698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2557edb1-39e6-41f6-a20b-4d223d4dce85 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.055086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397063b9-30da-4fd6-9029-f2a34a2b4816 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.065059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e9f70-bf7e-4143-a048-3b934782c748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.065059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e9f70-bf7e-4143-a048-3b934782c748 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.065059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e9f70-bf7e-4143-a048-3b934782c748 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.065059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e9f70-bf7e-4143-a048-3b934782c748 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.065365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e9f70-bf7e-4143-a048-3b934782c748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.067399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e9f70-bf7e-4143-a048-3b934782c748 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.075475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 808/1600] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:31.078399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e206-4ed1-44e7-9fe7-11544377a4a9 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.078829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e206-4ed1-44e7-9fe7-11544377a4a9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.079716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8e206-4ed1-44e7-9fe7-11544377a4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.079834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 793/1601] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:31.080784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e9f70-bf7e-4143-a048-3b934782c748 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.091356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e9f70-bf7e-4143-a048-3b934782c748 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.097487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e55091-7530-4eaf-b253-7e8981c3262e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.098334 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e55091-7530-4eaf-b253-7e8981c3262e admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.098685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e55091-7530-4eaf-b253-7e8981c3262e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.099790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e55091-7530-4eaf-b253-7e8981c3262e admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.100587 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e55091-7530-4eaf-b253-7e8981c3262e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.102308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e55091-7530-4eaf-b253-7e8981c3262e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.108639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d6c8e206-4ed1-44e7-9fe7-11544377a4a9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:31.110584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d6c8e206-4ed1-44e7-9fe7-11544377a4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:31.113087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 794/1602] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:31.114127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e55091-7530-4eaf-b253-7e8981c3262e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.124304 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 809/1603] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:31.126025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8e206-4ed1-44e7-9fe7-11544377a4a9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.129947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e55091-7530-4eaf-b253-7e8981c3262e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.136781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27912d-e641-4ef8-9c1d-d29664684d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.137847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27912d-e641-4ef8-9c1d-d29664684d1d admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.138205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27912d-e641-4ef8-9c1d-d29664684d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.138555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa27912d-e641-4ef8-9c1d-d29664684d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.139278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27912d-e641-4ef8-9c1d-d29664684d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.140778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8e206-4ed1-44e7-9fe7-11544377a4a9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.141284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa27912d-e641-4ef8-9c1d-d29664684d1d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.147340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceaa5d-a8d6-4090-85bb-11aeb069ca42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.148480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceaa5d-a8d6-4090-85bb-11aeb069ca42 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.149156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceaa5d-a8d6-4090-85bb-11aeb069ca42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.149709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ceaa5d-a8d6-4090-85bb-11aeb069ca42 admin admin] PATH_INFO: `/v3/projects/c31a926edb174052b6be117414610eb9/users/50262ab75897467e8342a486ed1fc94e/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.155982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 795/1604] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:31.157239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27912d-e641-4ef8-9c1d-d29664684d1d admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.171430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa27912d-e641-4ef8-9c1d-d29664684d1d admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.174747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ceaa5d-a8d6-4090-85bb-11aeb069ca42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c31a926edb174052b6be117414610eb9, user_id=50262ab75897467e8342a486ed1fc94e, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.178892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5619e9b-96e0-42bb-8ce7-d661d61cc64c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.179639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ceaa5d-a8d6-4090-85bb-11aeb069ca42 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.179906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5619e9b-96e0-42bb-8ce7-d661d61cc64c admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.180662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5619e9b-96e0-42bb-8ce7-d661d61cc64c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.181138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5619e9b-96e0-42bb-8ce7-d661d61cc64c admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.181962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5619e9b-96e0-42bb-8ce7-d661d61cc64c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.184206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5619e9b-96e0-42bb-8ce7-d661d61cc64c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.201368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 810/1605] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:31 2022] PUT /identity/v3/projects/c31a926edb174052b6be117414610eb9/users/50262ab75897467e8342a486ed1fc94e/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:31.201368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceaa5d-a8d6-4090-85bb-11aeb069ca42 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.201938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 796/1606] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:31.203361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5619e9b-96e0-42bb-8ce7-d661d61cc64c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.215888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5619e9b-96e0-42bb-8ce7-d661d61cc64c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.272236 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:31.291996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ceaa5d-a8d6-4090-85bb-11aeb069ca42 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.299132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5be5-ef11-4083-88c2-b473e84bb400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.300428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5be5-ef11-4083-88c2-b473e84bb400 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.300826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5be5-ef11-4083-88c2-b473e84bb400 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.301210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530e5be5-ef11-4083-88c2-b473e84bb400 admin admin] PATH_INFO: `/v3/projects/729a9ec9d2af438094ed4e7000d3d201/users/9adb6ad92cbf40db90405f8f45a9ae3a/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.304540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.305316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.305746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.306028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] PATH_INFO: `/v3/projects/86218bd2c78b47e0a572f7949e4fdbed/users/8f7b45b7c09d4b9ea68a11c3a341ed9e/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.322817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86218bd2c78b47e0a572f7949e4fdbed, user_id=8f7b45b7c09d4b9ea68a11c3a341ed9e, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.323012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e5be5-ef11-4083-88c2-b473e84bb400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=729a9ec9d2af438094ed4e7000d3d201, user_id=9adb6ad92cbf40db90405f8f45a9ae3a, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.323931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING py.warnings [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:48:31.323931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: warnings.warn(msg) Sep 17 00:48:31.323931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: Sep 17 00:48:31.325951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.326168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530e5be5-ef11-4083-88c2-b473e84bb400 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.328768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:31.341395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 797/1607] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:31 2022] PUT /identity/v3/projects/86218bd2c78b47e0a572f7949e4fdbed/users/8f7b45b7c09d4b9ea68a11c3a341ed9e/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:31.342069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.343629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 811/1608] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:31 2022] PUT /identity/v3/projects/729a9ec9d2af438094ed4e7000d3d201/users/9adb6ad92cbf40db90405f8f45a9ae3a/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:31.343982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:31.344812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5be5-ef11-4083-88c2-b473e84bb400 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.414052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4432e3a3-5902-4940-ac0e-4585f6410818 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.427062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530e5be5-ef11-4083-88c2-b473e84bb400 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.429633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17268c8f-6012-4131-8ddc-3ab297272d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.430314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17268c8f-6012-4131-8ddc-3ab297272d2b admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.430600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17268c8f-6012-4131-8ddc-3ab297272d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.430879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17268c8f-6012-4131-8ddc-3ab297272d2b admin admin] PATH_INFO: `/v3/projects/bf431bb930644348bef88df6766f9e31/users/e33cf9baa72248739f58cb3a3d7d078b/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.447646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17268c8f-6012-4131-8ddc-3ab297272d2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf431bb930644348bef88df6766f9e31, user_id=e33cf9baa72248739f58cb3a3d7d078b, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.450491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17268c8f-6012-4131-8ddc-3ab297272d2b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.466221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 812/1609] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:31 2022] PUT /identity/v3/projects/bf431bb930644348bef88df6766f9e31/users/e33cf9baa72248739f58cb3a3d7d078b/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:31.467094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17268c8f-6012-4131-8ddc-3ab297272d2b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.473053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4a371-2748-43a1-b7de-088353f9605d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.474379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4a371-2748-43a1-b7de-088353f9605d service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.474666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4a371-2748-43a1-b7de-088353f9605d service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.474937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4a371-2748-43a1-b7de-088353f9605d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.484679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4a371-2748-43a1-b7de-088353f9605d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.486145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4a371-2748-43a1-b7de-088353f9605d service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.497268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 798/1610] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:31.498571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48fcd-a504-42cd-930b-5a26099f2dd3 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.498848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48fcd-a504-42cd-930b-5a26099f2dd3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.499131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd48fcd-a504-42cd-930b-5a26099f2dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.519706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-efd48fcd-a504-42cd-930b-5a26099f2dd3 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:31.521463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-efd48fcd-a504-42cd-930b-5a26099f2dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:31.534342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17268c8f-6012-4131-8ddc-3ab297272d2b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.539678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73a1c5d-0ca7-46c2-ad39-a8e23009930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.540929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1c5d-0ca7-46c2-ad39-a8e23009930e admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.540929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1c5d-0ca7-46c2-ad39-a8e23009930e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.540929 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73a1c5d-0ca7-46c2-ad39-a8e23009930e admin admin] PATH_INFO: `/v3/projects/647bf797cfe64bcfa819774bd9676fd1/users/7666efadfe334fe8811a375d80fe6301/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.557035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a1c5d-0ca7-46c2-ad39-a8e23009930e admin admin] RBAC: Authorizing `identity:create_grant(project_id=647bf797cfe64bcfa819774bd9676fd1, user_id=7666efadfe334fe8811a375d80fe6301, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.559381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73a1c5d-0ca7-46c2-ad39-a8e23009930e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.574968 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 813/1611] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:31 2022] PUT /identity/v3/projects/647bf797cfe64bcfa819774bd9676fd1/users/7666efadfe334fe8811a375d80fe6301/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:31.576242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cbaa9-b01d-4071-8001-1ee5c6a82b5b None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.576554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cbaa9-b01d-4071-8001-1ee5c6a82b5b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.576826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cbaa9-b01d-4071-8001-1ee5c6a82b5b None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.578243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 814/1612] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 17 00:48:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:48:31.579095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d03b2d-d405-48e8-92a2-c6542b5c3fd6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.579599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d03b2d-d405-48e8-92a2-c6542b5c3fd6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.579875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d03b2d-d405-48e8-92a2-c6542b5c3fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.603361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 799/1613] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:31.603982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d04ee9-9760-4ec3-abca-9da891839dc1 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.604266 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d04ee9-9760-4ec3-abca-9da891839dc1 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.604538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d04ee9-9760-4ec3-abca-9da891839dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.613216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-97d03b2d-d405-48e8-92a2-c6542b5c3fd6 None None] MFA Rules not processed for user `8f7b45b7c09d4b9ea68a11c3a341ed9e`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:31.614686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-97d03b2d-d405-48e8-92a2-c6542b5c3fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:31.624066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e3d04ee9-9760-4ec3-abca-9da891839dc1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:31.625259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e3d04ee9-9760-4ec3-abca-9da891839dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:31.635379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:31.669781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:31.688914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 815/1614] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:31.694426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f5ffe-e37b-4d62-ab05-c03d37916109 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.694712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f5ffe-e37b-4d62-ab05-c03d37916109 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.695362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6f5ffe-e37b-4d62-ab05-c03d37916109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.711025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 800/1615] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:31.711025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ab0c-1563-4612-9396-806a8948912e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.711025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ab0c-1563-4612-9396-806a8948912e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.716563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ab6f5ffe-e37b-4d62-ab05-c03d37916109 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:31.718021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ab6f5ffe-e37b-4d62-ab05-c03d37916109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:31.718580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f2ab0c-1563-4612-9396-806a8948912e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.726940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 816/1616] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:31.731202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a993f-f07e-44b9-ad9c-681dc88b825d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.731879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a993f-f07e-44b9-ad9c-681dc88b825d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.731879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4a993f-f07e-44b9-ad9c-681dc88b825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.748550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e7f2ab0c-1563-4612-9396-806a8948912e None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:31.749754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e7f2ab0c-1563-4612-9396-806a8948912e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:31.769036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3b4a993f-f07e-44b9-ad9c-681dc88b825d None None] MFA Rules not processed for user `7666efadfe334fe8811a375d80fe6301`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:31.770342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3b4a993f-f07e-44b9-ad9c-681dc88b825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:31.847632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 801/1617] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:31.849471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2ab0c-1563-4612-9396-806a8948912e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.907469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 817/1618] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:31 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:31.912437 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a993f-f07e-44b9-ad9c-681dc88b825d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:31.949186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4a993f-f07e-44b9-ad9c-681dc88b825d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.962315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86001734-7fbc-4281-97ad-22eb2ebcac4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.962952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86001734-7fbc-4281-97ad-22eb2ebcac4d admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.963234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86001734-7fbc-4281-97ad-22eb2ebcac4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.963533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86001734-7fbc-4281-97ad-22eb2ebcac4d admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:31.964195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86001734-7fbc-4281-97ad-22eb2ebcac4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:31.971729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86001734-7fbc-4281-97ad-22eb2ebcac4d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:31.984313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f2ab0c-1563-4612-9396-806a8948912e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:31.991502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719df099-bbc3-4087-aa42-57ec21432948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:31.992105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719df099-bbc3-4087-aa42-57ec21432948 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:31.992462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719df099-bbc3-4087-aa42-57ec21432948 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:31.992717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719df099-bbc3-4087-aa42-57ec21432948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.014773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719df099-bbc3-4087-aa42-57ec21432948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.023436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719df099-bbc3-4087-aa42-57ec21432948 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.026847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 818/1619] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:31 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:32.028212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86001734-7fbc-4281-97ad-22eb2ebcac4d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:32.040468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 802/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:32.041598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719df099-bbc3-4087-aa42-57ec21432948 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:32.054451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719df099-bbc3-4087-aa42-57ec21432948 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:32.121078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fecc4e-7abe-4285-aa9a-8bc2f9ceb579 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:32.122112 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fecc4e-7abe-4285-aa9a-8bc2f9ceb579 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.122465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fecc4e-7abe-4285-aa9a-8bc2f9ceb579 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.122806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fecc4e-7abe-4285-aa9a-8bc2f9ceb579 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.127976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:32.153792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86001734-7fbc-4281-97ad-22eb2ebcac4d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:32.174327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea0b4c6-118d-4826-9aaa-fe4f9af84ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:32.178660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b4c6-118d-4826-9aaa-fe4f9af84ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.178966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b4c6-118d-4826-9aaa-fe4f9af84ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.179251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea0b4c6-118d-4826-9aaa-fe4f9af84ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.221837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fecc4e-7abe-4285-aa9a-8bc2f9ceb579 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.223653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fecc4e-7abe-4285-aa9a-8bc2f9ceb579 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.237432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 803/1621] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:32.238896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fecc4e-7abe-4285-aa9a-8bc2f9ceb579 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:32.321220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fecc4e-7abe-4285-aa9a-8bc2f9ceb579 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:32.325702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c42444-7262-4536-bc0e-62015ffb54c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:32.327027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42444-7262-4536-bc0e-62015ffb54c3 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.327431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42444-7262-4536-bc0e-62015ffb54c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.327805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c42444-7262-4536-bc0e-62015ffb54c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.364173 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0b4c6-118d-4826-9aaa-fe4f9af84ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.367942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea0b4c6-118d-4826-9aaa-fe4f9af84ea9 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.384910 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:32.401292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 819/1622] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:32.402698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdf5a0-462b-4e63-9e8f-d65bd1dca1e4 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.402997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdf5a0-462b-4e63-9e8f-d65bd1dca1e4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.403326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fdf5a0-462b-4e63-9e8f-d65bd1dca1e4 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.408418 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 820/1623] 10.222.0.16 () {54 vars in 965 bytes} [Sat Sep 17 00:48:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:48:32.409196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdf5a0-462b-4e63-9e8f-d65bd1dca1e4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:32.435673 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c42444-7262-4536-bc0e-62015ffb54c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.437423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c42444-7262-4536-bc0e-62015ffb54c3 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.440311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fdf5a0-462b-4e63-9e8f-d65bd1dca1e4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:32.454145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 804/1624] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:32.455790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e961d5c-4e42-46a6-886c-92ab338e247d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.456075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e961d5c-4e42-46a6-886c-92ab338e247d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.456351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e961d5c-4e42-46a6-886c-92ab338e247d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.461840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80471b7-0dfe-4b16-9102-268327a7f505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:32.462665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80471b7-0dfe-4b16-9102-268327a7f505 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.462950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80471b7-0dfe-4b16-9102-268327a7f505 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.463227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80471b7-0dfe-4b16-9102-268327a7f505 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.463883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80471b7-0dfe-4b16-9102-268327a7f505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.473056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80471b7-0dfe-4b16-9102-268327a7f505 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.477888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-4e961d5c-4e42-46a6-886c-92ab338e247d None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:32.479122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4e961d5c-4e42-46a6-886c-92ab338e247d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:32.499512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 805/1625] 10.222.0.16 () {58 vars in 1062 bytes} [Sat Sep 17 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:32.500490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e961d5c-4e42-46a6-886c-92ab338e247d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:32.514750 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e961d5c-4e42-46a6-886c-92ab338e247d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:32.522861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61da2a-ac2d-4ee1-ad2e-6a7d6b30159f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:32.523543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61da2a-ac2d-4ee1-ad2e-6a7d6b30159f service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.523814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61da2a-ac2d-4ee1-ad2e-6a7d6b30159f service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.524084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba61da2a-ac2d-4ee1-ad2e-6a7d6b30159f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.539749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 821/1626] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:32 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:32.540863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80471b7-0dfe-4b16-9102-268327a7f505 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:32.563090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80471b7-0dfe-4b16-9102-268327a7f505 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:32.577174 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5720c-3a6c-411c-8f2c-b220d5e241cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:32.578033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5720c-3a6c-411c-8f2c-b220d5e241cb admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.578463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5720c-3a6c-411c-8f2c-b220d5e241cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.578791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5720c-3a6c-411c-8f2c-b220d5e241cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.579563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5720c-3a6c-411c-8f2c-b220d5e241cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.585312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5720c-3a6c-411c-8f2c-b220d5e241cb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.588578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:32.614279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 822/1627] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:32.619262 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5720c-3a6c-411c-8f2c-b220d5e241cb admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:32.624601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61da2a-ac2d-4ee1-ad2e-6a7d6b30159f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.633726 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba61da2a-ac2d-4ee1-ad2e-6a7d6b30159f service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.644434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5720c-3a6c-411c-8f2c-b220d5e241cb admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:32.648162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 806/1628] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:32.658951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674ab8-5f66-4974-ba5d-7de0144f8851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:32.659639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674ab8-5f66-4974-ba5d-7de0144f8851 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.659922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674ab8-5f66-4974-ba5d-7de0144f8851 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.660199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674ab8-5f66-4974-ba5d-7de0144f8851 admin admin] PATH_INFO: `/v3/projects/e2ebee89fdd44560a8963b085fa0b1b6/users/cb0a44bf8b0240be9c4f195957f84142/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.691347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f674ab8-5f66-4974-ba5d-7de0144f8851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ebee89fdd44560a8963b085fa0b1b6, user_id=cb0a44bf8b0240be9c4f195957f84142, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.694139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f674ab8-5f66-4974-ba5d-7de0144f8851 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.719023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 823/1629] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:32 2022] PUT /identity/v3/projects/e2ebee89fdd44560a8963b085fa0b1b6/users/cb0a44bf8b0240be9c4f195957f84142/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:32.723321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61da2a-ac2d-4ee1-ad2e-6a7d6b30159f service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:32.740445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba61da2a-ac2d-4ee1-ad2e-6a7d6b30159f service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:32.867270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cfc47-c437-4352-8537-943f71cb920b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:32.868056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cfc47-c437-4352-8537-943f71cb920b admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.868394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cfc47-c437-4352-8537-943f71cb920b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.868784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cfc47-c437-4352-8537-943f71cb920b admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.869667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cfc47-c437-4352-8537-943f71cb920b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.872309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cfc47-c437-4352-8537-943f71cb920b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.889024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 807/1630] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:32 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:32.891839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674ab8-5f66-4974-ba5d-7de0144f8851 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:32.913861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674ab8-5f66-4974-ba5d-7de0144f8851 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:32.923637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cf6e9-05df-4d8e-b40f-c2d92f7fa69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:32.925793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cf6e9-05df-4d8e-b40f-c2d92f7fa69e admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.926160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cf6e9-05df-4d8e-b40f-c2d92f7fa69e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.927152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cf6e9-05df-4d8e-b40f-c2d92f7fa69e admin admin] PATH_INFO: `/v3/projects/e2ebee89fdd44560a8963b085fa0b1b6/users/cb0a44bf8b0240be9c4f195957f84142/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:32.936338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cf6e9-05df-4d8e-b40f-c2d92f7fa69e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ebee89fdd44560a8963b085fa0b1b6, user_id=cb0a44bf8b0240be9c4f195957f84142, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:32.939073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cf6e9-05df-4d8e-b40f-c2d92f7fa69e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:32.972365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 824/1631] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:32 2022] PUT /identity/v3/projects/e2ebee89fdd44560a8963b085fa0b1b6/users/cb0a44bf8b0240be9c4f195957f84142/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:32.983201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee831f-3cd7-48f6-ac1d-025c5e465971 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:32.983484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee831f-3cd7-48f6-ac1d-025c5e465971 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:32.983756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaee831f-3cd7-48f6-ac1d-025c5e465971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:33.000321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7facd-80c4-4a04-aae1-812624c8ded6 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:33.000617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7facd-80c4-4a04-aae1-812624c8ded6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:33.000892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb7facd-80c4-4a04-aae1-812624c8ded6 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:33.003064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 825/1632] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 17 00:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:48:33.008378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63ad4f-d039-49f8-abf0-67aa2492ac79 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:33.008664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63ad4f-d039-49f8-abf0-67aa2492ac79 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:33.008941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63ad4f-d039-49f8-abf0-67aa2492ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:33.033747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-eaee831f-3cd7-48f6-ac1d-025c5e465971 None None] MFA Rules not processed for user `cb0a44bf8b0240be9c4f195957f84142`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:33.035002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-eaee831f-3cd7-48f6-ac1d-025c5e465971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:33.037685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-1c63ad4f-d039-49f8-abf0-67aa2492ac79 None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:33.039128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1c63ad4f-d039-49f8-abf0-67aa2492ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:33.135025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 826/1633] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:33.151083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63ad4f-d039-49f8-abf0-67aa2492ac79 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:33.189467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 808/1634] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:32 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:33.240475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63ad4f-d039-49f8-abf0-67aa2492ac79 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:33.246069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ae6a8-7288-4825-a2c0-ea1ef3f79bcf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:33.246924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ae6a8-7288-4825-a2c0-ea1ef3f79bcf service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:33.247358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ae6a8-7288-4825-a2c0-ea1ef3f79bcf service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:33.247895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ae6a8-7288-4825-a2c0-ea1ef3f79bcf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:33.264798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ae6a8-7288-4825-a2c0-ea1ef3f79bcf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:33.266611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ae6a8-7288-4825-a2c0-ea1ef3f79bcf service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:33.280447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 827/1635] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:33.342153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee831f-3cd7-48f6-ac1d-025c5e465971 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:33.357119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaee831f-3cd7-48f6-ac1d-025c5e465971 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:33.361980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c502587-357d-4914-91a7-3b9ad2cee4f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:33.362815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502587-357d-4914-91a7-3b9ad2cee4f5 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:33.363255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502587-357d-4914-91a7-3b9ad2cee4f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:33.363823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c502587-357d-4914-91a7-3b9ad2cee4f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:33.374798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c502587-357d-4914-91a7-3b9ad2cee4f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:33.378291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c502587-357d-4914-91a7-3b9ad2cee4f5 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:33.402755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 809/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:33.433988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ae6a8-7288-4825-a2c0-ea1ef3f79bcf service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:33.494557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:33.551398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ae6a8-7288-4825-a2c0-ea1ef3f79bcf service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:33.560747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:33.561903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:33.562499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:33.563148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] PATH_INFO: `/v3/users/8f7b45b7c09d4b9ea68a11c3a341ed9e` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:33.576601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f7b45b7c09d4b9ea68a11c3a341ed9e)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:33.579297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:33.657797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f7b45b7c09d4b9ea68a11c3a341ed9e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:33.668637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f7b45b7c09d4b9ea68a11c3a341ed9e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:33.669432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f7b45b7c09d4b9ea68a11c3a341ed9e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:33.681792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f7b45b7c09d4b9ea68a11c3a341ed9e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:33.701624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f7b45b7c09d4b9ea68a11c3a341ed9e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:33.708802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 828/1637] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:48:33 2022] DELETE /identity/v3/users/8f7b45b7c09d4b9ea68a11c3a341ed9e => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:33.713871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4cf10-0736-41e5-a25f-4b404877c25a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:33.714243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4cf10-0736-41e5-a25f-4b404877c25a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:33.714619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4cf10-0736-41e5-a25f-4b404877c25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:33.763885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2da4cf10-0736-41e5-a25f-4b404877c25a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:33.765318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2da4cf10-0736-41e5-a25f-4b404877c25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:33.859893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:33.927525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:33.930696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:33.933985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 810/1638] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:34.092867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15495dbb-3bca-4a9c-bb74-4c45327b1802 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:34.102892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca77d91-7730-40e3-8ce3-c7ad6d10feef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:34.104170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca77d91-7730-40e3-8ce3-c7ad6d10feef service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:34.104714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca77d91-7730-40e3-8ce3-c7ad6d10feef service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:34.105515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca77d91-7730-40e3-8ce3-c7ad6d10feef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:34.122729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca77d91-7730-40e3-8ce3-c7ad6d10feef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:34.127080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca77d91-7730-40e3-8ce3-c7ad6d10feef service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:34.183601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 829/1639] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:48:35.340369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4cf10-0736-41e5-a25f-4b404877c25a None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:35.342790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2da4cf10-0736-41e5-a25f-4b404877c25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:35.371522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4cf10-0736-41e5-a25f-4b404877c25a None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:35.392792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:35.394523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:35.395364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:35.396567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] PATH_INFO: `/v3/projects/86218bd2c78b47e0a572f7949e4fdbed` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:35.398387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] RBAC: Authorizing `identity:delete_project(project_id=86218bd2c78b47e0a572f7949e4fdbed)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:35.402169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:35.515143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86218bd2c78b47e0a572f7949e4fdbed', 'request_id': 'req-eca889d6-d49b-40a5-920b-82aeb7fcc12f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.530867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86218bd2c78b47e0a572f7949e4fdbed', 'request_id': 'req-eca889d6-d49b-40a5-920b-82aeb7fcc12f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.558517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86218bd2c78b47e0a572f7949e4fdbed', 'request_id': 'req-eca889d6-d49b-40a5-920b-82aeb7fcc12f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.598546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] The token cache is being invalidate because project 86218bd2c78b47e0a572f7949e4fdbed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:48:35.598839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.599573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.602360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 811/1640] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:48:35 2022] DELETE /identity/v3/projects/86218bd2c78b47e0a572f7949e4fdbed => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:35.606177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca77d91-7730-40e3-8ce3-c7ad6d10feef service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:35.619737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca77d91-7730-40e3-8ce3-c7ad6d10feef service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:35.718735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:35.742521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:35.743523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:35.744152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:35.744559 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] PATH_INFO: `/v3/users/cb0a44bf8b0240be9c4f195957f84142` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:35.745985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0a44bf8b0240be9c4f195957f84142)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:35.748373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:35.848336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0a44bf8b0240be9c4f195957f84142'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.867818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0a44bf8b0240be9c4f195957f84142'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.868750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0a44bf8b0240be9c4f195957f84142'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.885334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0a44bf8b0240be9c4f195957f84142'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.916879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0a44bf8b0240be9c4f195957f84142'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:35.938532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 830/1641] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:48:35 2022] DELETE /identity/v3/users/cb0a44bf8b0240be9c4f195957f84142 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:36.758397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:36.761548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:36.780889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca889d6-d49b-40a5-920b-82aeb7fcc12f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:36.903741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:36.904749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:36.905161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:36.905630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] PATH_INFO: `/v3/users/8075a4a532e647949f38a1f928cb9caf` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:36.908274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8075a4a532e647949f38a1f928cb9caf)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:36.909885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: WARNING py.warnings [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:48:36.909885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: warnings.warn(msg) Sep 17 00:48:36.909885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: Sep 17 00:48:36.916767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:37.004170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:37.007049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:37.036249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea23d3-e137-4681-a8a8-800a7786c249 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:37.054345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:37.055646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:37.056556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:37.056835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] PATH_INFO: `/v3/projects/e2ebee89fdd44560a8963b085fa0b1b6` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:37.060255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ebee89fdd44560a8963b085fa0b1b6)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:37.061288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: WARNING py.warnings [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 17 00:48:37.061288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: warnings.warn(msg) Sep 17 00:48:37.061288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: Sep 17 00:48:37.065138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:37.081914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8075a4a532e647949f38a1f928cb9caf'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.102990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8075a4a532e647949f38a1f928cb9caf'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.103773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8075a4a532e647949f38a1f928cb9caf'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.155088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:37.161789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8075a4a532e647949f38a1f928cb9caf'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.176055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ebee89fdd44560a8963b085fa0b1b6', 'request_id': 'req-88c70323-673c-4fbc-a898-2b030147bd05'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.190141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1b252db3-2e43-4779-a4e9-9ba52a6088e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8075a4a532e647949f38a1f928cb9caf'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.192913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ebee89fdd44560a8963b085fa0b1b6', 'request_id': 'req-88c70323-673c-4fbc-a898-2b030147bd05'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.210651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ebee89fdd44560a8963b085fa0b1b6', 'request_id': 'req-88c70323-673c-4fbc-a898-2b030147bd05'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.223940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 812/1642] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:48:36 2022] DELETE /identity/v3/users/8075a4a532e647949f38a1f928cb9caf => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:37.228231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4422-c286-4f14-8150-28f5486695cb None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:37.228517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4422-c286-4f14-8150-28f5486695cb None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:37.228793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a4422-c286-4f14-8150-28f5486695cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:37.268072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] The token cache is being invalidate because project e2ebee89fdd44560a8963b085fa0b1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:48:37.268377 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.272131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-88c70323-673c-4fbc-a898-2b030147bd05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:37.276026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 831/1643] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:48:37 2022] DELETE /identity/v3/projects/e2ebee89fdd44560a8963b085fa0b1b6 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:37.277893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-928a4422-c286-4f14-8150-28f5486695cb None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:37.280656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57956bc6-5026-41e4-aab0-6e4093b5a7b6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:37.280948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57956bc6-5026-41e4-aab0-6e4093b5a7b6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:37.281225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57956bc6-5026-41e4-aab0-6e4093b5a7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:37.285344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-928a4422-c286-4f14-8150-28f5486695cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:37.328869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-57956bc6-5026-41e4-aab0-6e4093b5a7b6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:37.335440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-57956bc6-5026-41e4-aab0-6e4093b5a7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:37.438193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 813/1644] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:37.467050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:37.503963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 832/1645] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:37.514272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb00aa-1947-4ea4-8e92-9ecc3c135c5a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:37.514665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb00aa-1947-4ea4-8e92-9ecc3c135c5a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:37.521899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41bb00aa-1947-4ea4-8e92-9ecc3c135c5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:37.551145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-41bb00aa-1947-4ea4-8e92-9ecc3c135c5a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:37.556216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-41bb00aa-1947-4ea4-8e92-9ecc3c135c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:37.572549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 814/1646] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:37.573857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57956bc6-5026-41e4-aab0-6e4093b5a7b6 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:37.592241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57956bc6-5026-41e4-aab0-6e4093b5a7b6 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:37.599567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94ff17-5d98-4574-a17f-f115dd4dbeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:37.600153 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94ff17-5d98-4574-a17f-f115dd4dbeb1 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:37.600438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94ff17-5d98-4574-a17f-f115dd4dbeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:37.600712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c94ff17-5d98-4574-a17f-f115dd4dbeb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:37.601385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94ff17-5d98-4574-a17f-f115dd4dbeb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:37.601720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94ff17-5d98-4574-a17f-f115dd4dbeb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:37.603518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c94ff17-5d98-4574-a17f-f115dd4dbeb1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:37.631708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb00aa-1947-4ea4-8e92-9ecc3c135c5a None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:37.634421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-41bb00aa-1947-4ea4-8e92-9ecc3c135c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:37.635804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 833/1647] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:37.637109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94ff17-5d98-4574-a17f-f115dd4dbeb1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:37.663192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c94ff17-5d98-4574-a17f-f115dd4dbeb1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:37.671136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206c53-bbb8-4488-9e8c-90f92ab52ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:37.672033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206c53-bbb8-4488-9e8c-90f92ab52ccd admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:37.672569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206c53-bbb8-4488-9e8c-90f92ab52ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:37.672996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2206c53-bbb8-4488-9e8c-90f92ab52ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:37.673921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2206c53-bbb8-4488-9e8c-90f92ab52ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:37.676053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2206c53-bbb8-4488-9e8c-90f92ab52ccd admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:37.741810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 834/1648] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:37 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:37.746823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206c53-bbb8-4488-9e8c-90f92ab52ccd admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:37.762110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41bb00aa-1947-4ea4-8e92-9ecc3c135c5a None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:37.859506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2206c53-bbb8-4488-9e8c-90f92ab52ccd admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:37.880417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951e3ce-7aad-42eb-9a1b-0259b376bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:37.887750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951e3ce-7aad-42eb-9a1b-0259b376bca9 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:37.892935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951e3ce-7aad-42eb-9a1b-0259b376bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:37.896176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4951e3ce-7aad-42eb-9a1b-0259b376bca9 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:37.900753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951e3ce-7aad-42eb-9a1b-0259b376bca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:37.909203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4951e3ce-7aad-42eb-9a1b-0259b376bca9 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:37.961514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce699b-e5b3-4098-b4c0-e252985f6d9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:37.962675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce699b-e5b3-4098-b4c0-e252985f6d9f service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:37.963126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce699b-e5b3-4098-b4c0-e252985f6d9f service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:37.963410 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fce699b-e5b3-4098-b4c0-e252985f6d9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:37.983452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 835/1649] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:37 2022] POST /identity/v3/users => generated 291 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:37.985442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951e3ce-7aad-42eb-9a1b-0259b376bca9 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:37.995690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce699b-e5b3-4098-b4c0-e252985f6d9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:37.999925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fce699b-e5b3-4098-b4c0-e252985f6d9f service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:38.029273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4951e3ce-7aad-42eb-9a1b-0259b376bca9 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:38.046752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df63f0-a90b-4f12-86ca-1fd0f956ea3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:38.049199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 815/1650] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:48:38.049390 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df63f0-a90b-4f12-86ca-1fd0f956ea3d admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:38.049858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df63f0-a90b-4f12-86ca-1fd0f956ea3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:38.050142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df63f0-a90b-4f12-86ca-1fd0f956ea3d admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:38.051077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df63f0-a90b-4f12-86ca-1fd0f956ea3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:38.054370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70df63f0-a90b-4f12-86ca-1fd0f956ea3d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:38.068728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 836/1651] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:38.073390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce699b-e5b3-4098-b4c0-e252985f6d9f service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:38.086651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fce699b-e5b3-4098-b4c0-e252985f6d9f service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:38.097089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ecb17-1bae-4659-a61a-1e0da948d37b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:38.097997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ecb17-1bae-4659-a61a-1e0da948d37b admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:38.099880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ecb17-1bae-4659-a61a-1e0da948d37b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:38.100280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ecb17-1bae-4659-a61a-1e0da948d37b admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:38.101471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ecb17-1bae-4659-a61a-1e0da948d37b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:38.104367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ecb17-1bae-4659-a61a-1e0da948d37b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:38.126518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 816/1652] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:38.132120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df63f0-a90b-4f12-86ca-1fd0f956ea3d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:38.152156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df63f0-a90b-4f12-86ca-1fd0f956ea3d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:38.160121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaec02-7c26-4f77-93f9-5e32414fc1ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:38.161620 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaec02-7c26-4f77-93f9-5e32414fc1ee admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:38.162515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaec02-7c26-4f77-93f9-5e32414fc1ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:38.162615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eaec02-7c26-4f77-93f9-5e32414fc1ee admin admin] PATH_INFO: `/v3/projects/1753455597cc42729bdc708a5a14e952/users/a408dc924c734ae581b33d71100dde2d/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:38.183866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaec02-7c26-4f77-93f9-5e32414fc1ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=1753455597cc42729bdc708a5a14e952, user_id=a408dc924c734ae581b33d71100dde2d, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:38.194858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eaec02-7c26-4f77-93f9-5e32414fc1ee admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:38.217002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 837/1653] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:38 2022] PUT /identity/v3/projects/1753455597cc42729bdc708a5a14e952/users/a408dc924c734ae581b33d71100dde2d/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:48:38.230090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52918bf-85a9-4fdc-a8f4-ddd9d303590d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:38.231195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52918bf-85a9-4fdc-a8f4-ddd9d303590d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:38.231195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52918bf-85a9-4fdc-a8f4-ddd9d303590d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:38.265184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d52918bf-85a9-4fdc-a8f4-ddd9d303590d None None] MFA Rules not processed for user `a408dc924c734ae581b33d71100dde2d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:38.266775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d52918bf-85a9-4fdc-a8f4-ddd9d303590d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:38.287409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:38.355712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 817/1654] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:38 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:38.359985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaec02-7c26-4f77-93f9-5e32414fc1ee admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:38.464831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eaec02-7c26-4f77-93f9-5e32414fc1ee admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:38.471685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822758a7-3667-4074-948f-cc4e0355a1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:38.472673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822758a7-3667-4074-948f-cc4e0355a1be admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:38.473105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822758a7-3667-4074-948f-cc4e0355a1be admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:38.474114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822758a7-3667-4074-948f-cc4e0355a1be admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:38.474973 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822758a7-3667-4074-948f-cc4e0355a1be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:38.478287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822758a7-3667-4074-948f-cc4e0355a1be admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:38.515646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:38.528479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 838/1655] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:38 2022] POST /identity/v3/projects => generated 383 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:38.533343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52918bf-85a9-4fdc-a8f4-ddd9d303590d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:38.546580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52918bf-85a9-4fdc-a8f4-ddd9d303590d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:38.629912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91a16f-da04-4dca-9975-74f6beb653e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:38.630610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91a16f-da04-4dca-9975-74f6beb653e9 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:38.630965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91a16f-da04-4dca-9975-74f6beb653e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:38.631313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b91a16f-da04-4dca-9975-74f6beb653e9 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:38.632085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91a16f-da04-4dca-9975-74f6beb653e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:38.634308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b91a16f-da04-4dca-9975-74f6beb653e9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:38.677946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 818/1656] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:38 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:38.679381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822758a7-3667-4074-948f-cc4e0355a1be admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:38.692313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822758a7-3667-4074-948f-cc4e0355a1be admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:38.702066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200e60d-a58d-4290-8dc5-f29747f703d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:38.703153 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e60d-a58d-4290-8dc5-f29747f703d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:38.703755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e60d-a58d-4290-8dc5-f29747f703d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:38.704278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2200e60d-a58d-4290-8dc5-f29747f703d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:38.705142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200e60d-a58d-4290-8dc5-f29747f703d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:38.716270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2200e60d-a58d-4290-8dc5-f29747f703d8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:38.745561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 839/1657] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:38.749783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91a16f-da04-4dca-9975-74f6beb653e9 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:38.765733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b91a16f-da04-4dca-9975-74f6beb653e9 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:38.788480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaeef6-8cf5-4371-9dc8-4a4b299e9139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:38.791307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaeef6-8cf5-4371-9dc8-4a4b299e9139 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:38.791834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaeef6-8cf5-4371-9dc8-4a4b299e9139 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:38.792365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaeef6-8cf5-4371-9dc8-4a4b299e9139 admin admin] PATH_INFO: `/v3/projects/ce0a1423506e4181866eb445ebf5b180/users/5e2f0144e6f34d3a995a1431a7812732/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:38.818275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaeef6-8cf5-4371-9dc8-4a4b299e9139 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0a1423506e4181866eb445ebf5b180, user_id=5e2f0144e6f34d3a995a1431a7812732, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:38.822764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbaeef6-8cf5-4371-9dc8-4a4b299e9139 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:38.860438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 819/1658] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:38 2022] PUT /identity/v3/projects/ce0a1423506e4181866eb445ebf5b180/users/5e2f0144e6f34d3a995a1431a7812732/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:38.861281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200e60d-a58d-4290-8dc5-f29747f703d8 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:38.877027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2200e60d-a58d-4290-8dc5-f29747f703d8 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:38.976511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e1474a-1fde-4d01-9d81-b95e0bf76b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:38.977524 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1474a-1fde-4d01-9d81-b95e0bf76b65 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:38.978003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1474a-1fde-4d01-9d81-b95e0bf76b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:38.978490 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e1474a-1fde-4d01-9d81-b95e0bf76b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:38.980301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1474a-1fde-4d01-9d81-b95e0bf76b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:38.984251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e1474a-1fde-4d01-9d81-b95e0bf76b65 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:39.002312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 840/1659] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:38 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:39.012149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaeef6-8cf5-4371-9dc8-4a4b299e9139 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:39.052539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaeef6-8cf5-4371-9dc8-4a4b299e9139 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:39.062947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab880a-50e6-4519-b846-a0e84720da93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:39.064084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab880a-50e6-4519-b846-a0e84720da93 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:39.064785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab880a-50e6-4519-b846-a0e84720da93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:39.065051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab880a-50e6-4519-b846-a0e84720da93 admin admin] PATH_INFO: `/v3/projects/ce0a1423506e4181866eb445ebf5b180/users/5e2f0144e6f34d3a995a1431a7812732/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:39.069154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab880a-50e6-4519-b846-a0e84720da93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce0a1423506e4181866eb445ebf5b180, user_id=5e2f0144e6f34d3a995a1431a7812732, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:39.071935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab880a-50e6-4519-b846-a0e84720da93 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:39.094495 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 820/1660] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:39 2022] PUT /identity/v3/projects/ce0a1423506e4181866eb445ebf5b180/users/5e2f0144e6f34d3a995a1431a7812732/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:39.100788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04449dc-a166-49c8-958f-9eebc6cba306 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:39.101313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04449dc-a166-49c8-958f-9eebc6cba306 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:39.101390 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04449dc-a166-49c8-958f-9eebc6cba306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:39.137398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a04449dc-a166-49c8-958f-9eebc6cba306 None None] MFA Rules not processed for user `5e2f0144e6f34d3a995a1431a7812732`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:39.138358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a04449dc-a166-49c8-958f-9eebc6cba306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:39.276610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 841/1661] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:39.297555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab880a-50e6-4519-b846-a0e84720da93 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:39.301480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-10ab880a-50e6-4519-b846-a0e84720da93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:39.408812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04449dc-a166-49c8-958f-9eebc6cba306 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:39.410551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a04449dc-a166-49c8-958f-9eebc6cba306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:39.455566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab880a-50e6-4519-b846-a0e84720da93 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:39.462703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd7880-ba06-4e02-a66b-3424e25319f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:39.464059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd7880-ba06-4e02-a66b-3424e25319f1 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:39.465217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd7880-ba06-4e02-a66b-3424e25319f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:39.465740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd7880-ba06-4e02-a66b-3424e25319f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:39.480915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd7880-ba06-4e02-a66b-3424e25319f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:39.483521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd7880-ba06-4e02-a66b-3424e25319f1 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:39.496344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 821/1662] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:39.586237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04449dc-a166-49c8-958f-9eebc6cba306 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:39.622319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:39.622999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:39.623283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:39.623560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] PATH_INFO: `/v3/users/7666efadfe334fe8811a375d80fe6301` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:39.629109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7666efadfe334fe8811a375d80fe6301)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:39.633373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:39.654179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:39.726476 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd7880-ba06-4e02-a66b-3424e25319f1 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:39.739551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd7880-ba06-4e02-a66b-3424e25319f1 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:39.742460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7666efadfe334fe8811a375d80fe6301'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:39.754465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7666efadfe334fe8811a375d80fe6301'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:39.756115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:39.756296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7666efadfe334fe8811a375d80fe6301'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:39.756991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:39.757425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:39.757767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:39.764003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:39.782035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7666efadfe334fe8811a375d80fe6301'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:39.803252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da8f9d2b-9844-478c-b827-3fdc02c99247 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7666efadfe334fe8811a375d80fe6301'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:39.814533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:39.821356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 842/1663] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:48:39 2022] DELETE /identity/v3/users/7666efadfe334fe8811a375d80fe6301 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:48:39.825456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d1f6b-47a2-45e8-a68e-f476a724f5ac None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:39.825753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d1f6b-47a2-45e8-a68e-f476a724f5ac None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:39.826026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611d1f6b-47a2-45e8-a68e-f476a724f5ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:39.875128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-611d1f6b-47a2-45e8-a68e-f476a724f5ac None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:39.881048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-611d1f6b-47a2-45e8-a68e-f476a724f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:39.962956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:39.964537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:39.997907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 822/1664] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:48:40.056178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 843/1665] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:40.094047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:40.095674 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:40.206542 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ca1c3-0cad-4c1e-a933-dc35658f99a5 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:40.327457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597448df-d597-4862-b90f-d5f94a0a550e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:40.328223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597448df-d597-4862-b90f-d5f94a0a550e service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:40.328617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597448df-d597-4862-b90f-d5f94a0a550e service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:40.329005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597448df-d597-4862-b90f-d5f94a0a550e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:40.348046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597448df-d597-4862-b90f-d5f94a0a550e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:40.350174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597448df-d597-4862-b90f-d5f94a0a550e service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:40.373897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 823/1666] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:40.510983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d1f6b-47a2-45e8-a68e-f476a724f5ac None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:40.512961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-611d1f6b-47a2-45e8-a68e-f476a724f5ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:40.535274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611d1f6b-47a2-45e8-a68e-f476a724f5ac None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:40.546752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:40.547420 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:40.547703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:40.547991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] PATH_INFO: `/v3/users/a408dc924c734ae581b33d71100dde2d` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:40.549343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a408dc924c734ae581b33d71100dde2d)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:40.551329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:40.639255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a408dc924c734ae581b33d71100dde2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:40.650436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a408dc924c734ae581b33d71100dde2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:40.651507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a408dc924c734ae581b33d71100dde2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:40.667669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a408dc924c734ae581b33d71100dde2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:40.691334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a408dc924c734ae581b33d71100dde2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:40.713758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:40.722105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 844/1667] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:48:40 2022] DELETE /identity/v3/users/a408dc924c734ae581b33d71100dde2d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:40.726988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d349a-7f76-42fb-83a6-74c9d831195c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:40.727324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d349a-7f76-42fb-83a6-74c9d831195c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:40.727609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6d349a-7f76-42fb-83a6-74c9d831195c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:40.765772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-4d6d349a-7f76-42fb-83a6-74c9d831195c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:40.767265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4d6d349a-7f76-42fb-83a6-74c9d831195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:40.809530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:40.811399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:40.901501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 824/1668] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:40.944900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d349a-7f76-42fb-83a6-74c9d831195c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:40.946386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4d6d349a-7f76-42fb-83a6-74c9d831195c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:40.948866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1c9c6f-1633-491f-9305-14a0c857bdfe admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:40.968189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:40.968843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:40.970780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:40.971287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:40.971847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] PATH_INFO: `/v3/projects/1e9d2a334cbb47329690f1bcb260cc25` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:40.974576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e9d2a334cbb47329690f1bcb260cc25)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:40.978182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:41.061184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e9d2a334cbb47329690f1bcb260cc25', 'request_id': 'req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:41.062747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6d349a-7f76-42fb-83a6-74c9d831195c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:41.077774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e9d2a334cbb47329690f1bcb260cc25', 'request_id': 'req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:41.093570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e9d2a334cbb47329690f1bcb260cc25', 'request_id': 'req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:41.123624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] The token cache is being invalidate because project 1e9d2a334cbb47329690f1bcb260cc25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:48:41.123966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:41.125207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b7d0dc3d-a184-4e83-b7ae-0fed8117c1aa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:41.135834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 845/1669] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:48:40 2022] DELETE /identity/v3/projects/1e9d2a334cbb47329690f1bcb260cc25 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:41.138460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaea3a-ea0e-499f-9236-4c6a567e5529 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:41.138763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaea3a-ea0e-499f-9236-4c6a567e5529 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:41.139021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eaea3a-ea0e-499f-9236-4c6a567e5529 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:41.183605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7749-2c94-4907-a99f-efb1b28a1a7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:41.184238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7749-2c94-4907-a99f-efb1b28a1a7a service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:41.184519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7749-2c94-4907-a99f-efb1b28a1a7a service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:41.184796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe7749-2c94-4907-a99f-efb1b28a1a7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:41.185538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b2eaea3a-ea0e-499f-9236-4c6a567e5529 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:41.187471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b2eaea3a-ea0e-499f-9236-4c6a567e5529 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:41.193958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-6bbe7749-2c94-4907-a99f-efb1b28a1a7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:41.325638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 846/1670] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:41.336555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe7749-2c94-4907-a99f-efb1b28a1a7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:41.338326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe7749-2c94-4907-a99f-efb1b28a1a7a service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:41.339090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96c301-e914-4ab3-95bc-229d28651699 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:41.339549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96c301-e914-4ab3-95bc-229d28651699 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:41.340079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96c301-e914-4ab3-95bc-229d28651699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:41.361521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 825/1671] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:48:41.381514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-4e96c301-e914-4ab3-95bc-229d28651699 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:41.389865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4e96c301-e914-4ab3-95bc-229d28651699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:41.407458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7749-2c94-4907-a99f-efb1b28a1a7a service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:41.407673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 847/1672] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:41.435057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe7749-2c94-4907-a99f-efb1b28a1a7a service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:41.449456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dbc62-4382-430c-828d-cde367b56c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:41.450255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbc62-4382-430c-828d-cde367b56c52 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:41.450537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbc62-4382-430c-828d-cde367b56c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:41.450809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71dbc62-4382-430c-828d-cde367b56c52 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:41.453344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71dbc62-4382-430c-828d-cde367b56c52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:41.453683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71dbc62-4382-430c-828d-cde367b56c52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:41.462589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71dbc62-4382-430c-828d-cde367b56c52 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:41.485211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 826/1673] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:48:41.490753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96c301-e914-4ab3-95bc-229d28651699 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:41.539656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96c301-e914-4ab3-95bc-229d28651699 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:41.553626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e667bc7-7c82-41dd-8019-d496fe5fbdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:41.590698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667bc7-7c82-41dd-8019-d496fe5fbdad admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:41.591763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667bc7-7c82-41dd-8019-d496fe5fbdad admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:41.593957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e667bc7-7c82-41dd-8019-d496fe5fbdad admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:41.597068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e667bc7-7c82-41dd-8019-d496fe5fbdad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:41.604915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e667bc7-7c82-41dd-8019-d496fe5fbdad admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:41.702457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dbc62-4382-430c-828d-cde367b56c52 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:41.702642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 848/1674] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:41 2022] POST /identity/v3/projects => generated 367 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:41.725611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71dbc62-4382-430c-828d-cde367b56c52 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:41.886812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da27a17-42f6-44cc-8230-73bd0a24f6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:41.889619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da27a17-42f6-44cc-8230-73bd0a24f6ed admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:41.890193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da27a17-42f6-44cc-8230-73bd0a24f6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:41.890690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da27a17-42f6-44cc-8230-73bd0a24f6ed admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:41.891508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da27a17-42f6-44cc-8230-73bd0a24f6ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:41.900323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da27a17-42f6-44cc-8230-73bd0a24f6ed admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:41.917986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:41.974822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 827/1675] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:41 2022] POST /identity/v3/users => generated 284 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:41.979139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e667bc7-7c82-41dd-8019-d496fe5fbdad admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:41.985475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:41.996205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e667bc7-7c82-41dd-8019-d496fe5fbdad admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:42.018947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4175f84-8b35-4a89-ac7a-437b39b17d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:42.020211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4175f84-8b35-4a89-ac7a-437b39b17d9d admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:42.021255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4175f84-8b35-4a89-ac7a-437b39b17d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:42.021255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4175f84-8b35-4a89-ac7a-437b39b17d9d admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:42.022065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4175f84-8b35-4a89-ac7a-437b39b17d9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:42.026626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4175f84-8b35-4a89-ac7a-437b39b17d9d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:42.062633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 849/1676] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:41 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:42.067830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da27a17-42f6-44cc-8230-73bd0a24f6ed admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:42.082720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da27a17-42f6-44cc-8230-73bd0a24f6ed admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:42.113777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405648a5-d598-4880-9888-f77f444a3711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:42.115253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405648a5-d598-4880-9888-f77f444a3711 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:42.115702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405648a5-d598-4880-9888-f77f444a3711 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:42.116889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405648a5-d598-4880-9888-f77f444a3711 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:42.119149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405648a5-d598-4880-9888-f77f444a3711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:42.122350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405648a5-d598-4880-9888-f77f444a3711 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:42.169738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 828/1677] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:42 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:42.174316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4175f84-8b35-4a89-ac7a-437b39b17d9d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:42.201809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4175f84-8b35-4a89-ac7a-437b39b17d9d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:42.219351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2dc0d-76c6-4e02-acf2-5b3af3ec62c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:42.220136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2dc0d-76c6-4e02-acf2-5b3af3ec62c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:42.220417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2dc0d-76c6-4e02-acf2-5b3af3ec62c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:42.220690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e2dc0d-76c6-4e02-acf2-5b3af3ec62c9 admin admin] PATH_INFO: `/v3/projects/109a02e582ad4d1aa61f468ae7a113c3/users/1c41ee8e1f0e4fd78791d3528e054e2d/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:42.307853 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2dc0d-76c6-4e02-acf2-5b3af3ec62c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=109a02e582ad4d1aa61f468ae7a113c3, user_id=1c41ee8e1f0e4fd78791d3528e054e2d, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:42.338180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e2dc0d-76c6-4e02-acf2-5b3af3ec62c9 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:42.389610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 850/1678] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:42 2022] PUT /identity/v3/projects/109a02e582ad4d1aa61f468ae7a113c3/users/1c41ee8e1f0e4fd78791d3528e054e2d/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:42.402552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605776-71cf-4769-a2ea-1edc91d8ba12 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:42.403094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605776-71cf-4769-a2ea-1edc91d8ba12 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:42.403554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52605776-71cf-4769-a2ea-1edc91d8ba12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:42.456613 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-52605776-71cf-4769-a2ea-1edc91d8ba12 None None] MFA Rules not processed for user `1c41ee8e1f0e4fd78791d3528e054e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:42.458704 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-52605776-71cf-4769-a2ea-1edc91d8ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:42.591297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 829/1679] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:42.610277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2dc0d-76c6-4e02-acf2-5b3af3ec62c9 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:42.613758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a5e2dc0d-76c6-4e02-acf2-5b3af3ec62c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:42.756168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e2dc0d-76c6-4e02-acf2-5b3af3ec62c9 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:42.764984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3060a9bb-7e3d-407c-8525-c02946e18dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:42.766360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060a9bb-7e3d-407c-8525-c02946e18dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:42.766824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060a9bb-7e3d-407c-8525-c02946e18dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:42.767486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3060a9bb-7e3d-407c-8525-c02946e18dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:42.783011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060a9bb-7e3d-407c-8525-c02946e18dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:42.785442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3060a9bb-7e3d-407c-8525-c02946e18dd2 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:42.806123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 851/1680] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:43.250667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52605776-71cf-4769-a2ea-1edc91d8ba12 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:43.252153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-52605776-71cf-4769-a2ea-1edc91d8ba12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:43.472588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52605776-71cf-4769-a2ea-1edc91d8ba12 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:43.487363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:43.488302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:43.488769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:43.489717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] PATH_INFO: `/v3/projects/647bf797cfe64bcfa819774bd9676fd1` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:43.491588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=647bf797cfe64bcfa819774bd9676fd1)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:43.494013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:43.610761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '647bf797cfe64bcfa819774bd9676fd1', 'request_id': 'req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:43.665530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '647bf797cfe64bcfa819774bd9676fd1', 'request_id': 'req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:43.677853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '647bf797cfe64bcfa819774bd9676fd1', 'request_id': 'req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:43.692177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:43.701090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] The token cache is being invalidate because project 647bf797cfe64bcfa819774bd9676fd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:48:43.703846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:43.705388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-20f6008f-9b6a-4f66-a80d-3dbe4f912cc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:43.709057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 830/1681] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:48:43 2022] DELETE /identity/v3/projects/647bf797cfe64bcfa819774bd9676fd1 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:43.714146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516097d-a5ed-4777-a526-cbe6e43fa757 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:43.715269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516097d-a5ed-4777-a526-cbe6e43fa757 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:43.716143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c516097d-a5ed-4777-a526-cbe6e43fa757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:43.776912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c516097d-a5ed-4777-a526-cbe6e43fa757 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:43.780416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c516097d-a5ed-4777-a526-cbe6e43fa757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:43.922606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 852/1682] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:43.931263 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804c91f-9d5e-4728-8768-d0a746053e5b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:43.931866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804c91f-9d5e-4728-8768-d0a746053e5b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:43.932364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d804c91f-9d5e-4728-8768-d0a746053e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.006535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d804c91f-9d5e-4728-8768-d0a746053e5b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:44.014735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d804c91f-9d5e-4728-8768-d0a746053e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:44.045805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516097d-a5ed-4777-a526-cbe6e43fa757 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:44.060529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 831/1683] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:44.067388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c516097d-a5ed-4777-a526-cbe6e43fa757 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:44.085306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5cee6-5dac-4c3f-aa52-faba14d593a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:44.089803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5cee6-5dac-4c3f-aa52-faba14d593a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:44.090563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5cee6-5dac-4c3f-aa52-faba14d593a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:44.090956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5cee6-5dac-4c3f-aa52-faba14d593a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.092702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5cee6-5dac-4c3f-aa52-faba14d593a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:44.093956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5cee6-5dac-4c3f-aa52-faba14d593a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:44.100567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a5cee6-5dac-4c3f-aa52-faba14d593a1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:44.141697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 853/1684] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:44.144665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804c91f-9d5e-4728-8768-d0a746053e5b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:44.156077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d804c91f-9d5e-4728-8768-d0a746053e5b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:44.172604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc25f2a-dea5-469e-8d2c-43a1a84ebd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:44.173616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc25f2a-dea5-469e-8d2c-43a1a84ebd59 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:44.174161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc25f2a-dea5-469e-8d2c-43a1a84ebd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:44.176589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc25f2a-dea5-469e-8d2c-43a1a84ebd59 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.176589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc25f2a-dea5-469e-8d2c-43a1a84ebd59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:44.180269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc25f2a-dea5-469e-8d2c-43a1a84ebd59 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:44.234514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 832/1685] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:44 2022] POST /identity/v3/projects => generated 377 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:44.238794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5cee6-5dac-4c3f-aa52-faba14d593a1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:44.264140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a5cee6-5dac-4c3f-aa52-faba14d593a1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:44.325788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc25f2a-dea5-469e-8d2c-43a1a84ebd59 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:44.327832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8dc25f2a-dea5-469e-8d2c-43a1a84ebd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:44.368991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:44.396838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb8be-e362-4b86-85f4-f93d47cf69d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:44.398238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb8be-e362-4b86-85f4-f93d47cf69d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:44.400692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb8be-e362-4b86-85f4-f93d47cf69d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:44.402888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdfb8be-e362-4b86-85f4-f93d47cf69d5 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.410622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfb8be-e362-4b86-85f4-f93d47cf69d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:44.432107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdfb8be-e362-4b86-85f4-f93d47cf69d5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:44.485184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 854/1686] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:44 2022] POST /identity/v3/users => generated 289 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:44.489229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb8be-e362-4b86-85f4-f93d47cf69d5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:44.513869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc25f2a-dea5-469e-8d2c-43a1a84ebd59 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:44.519507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:44.520968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:44.521183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdfb8be-e362-4b86-85f4-f93d47cf69d5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:44.521638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:44.522061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] PATH_INFO: `/v3/projects/1753455597cc42729bdc708a5a14e952` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.523473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1753455597cc42729bdc708a5a14e952)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:44.525792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:44.536418 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267801-4cd4-49f6-9920-408770ddc995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:44.537322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267801-4cd4-49f6-9920-408770ddc995 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:44.537786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267801-4cd4-49f6-9920-408770ddc995 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:44.538206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a267801-4cd4-49f6-9920-408770ddc995 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.539029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a267801-4cd4-49f6-9920-408770ddc995 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:44.540963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a267801-4cd4-49f6-9920-408770ddc995 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:44.566182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 855/1687] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:48:44.568183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267801-4cd4-49f6-9920-408770ddc995 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:44.588495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a267801-4cd4-49f6-9920-408770ddc995 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:44.602125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4db8d0-3d71-45f3-93d8-09826cbfc1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:44.602750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4db8d0-3d71-45f3-93d8-09826cbfc1f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:44.603030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4db8d0-3d71-45f3-93d8-09826cbfc1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:44.603410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4db8d0-3d71-45f3-93d8-09826cbfc1f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.603961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4db8d0-3d71-45f3-93d8-09826cbfc1f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:44.605613 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4db8d0-3d71-45f3-93d8-09826cbfc1f7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:44.616317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1753455597cc42729bdc708a5a14e952', 'request_id': 'req-9b01b8e7-53cc-4a94-b5bd-a37778622619'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.626374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1753455597cc42729bdc708a5a14e952', 'request_id': 'req-9b01b8e7-53cc-4a94-b5bd-a37778622619'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.630499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 856/1688] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:44.632799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4db8d0-3d71-45f3-93d8-09826cbfc1f7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:44.640375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1753455597cc42729bdc708a5a14e952', 'request_id': 'req-9b01b8e7-53cc-4a94-b5bd-a37778622619'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.647843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4db8d0-3d71-45f3-93d8-09826cbfc1f7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:44.656335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] The token cache is being invalidate because project 1753455597cc42729bdc708a5a14e952 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:48:44.656832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.657707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.670380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 833/1689] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:48:44 2022] DELETE /identity/v3/projects/1753455597cc42729bdc708a5a14e952 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:44.670380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:44.670380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:44.753669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71486fc7-68ac-4bb0-8cc3-7d5a202da02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:44.754565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71486fc7-68ac-4bb0-8cc3-7d5a202da02e admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:44.754839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71486fc7-68ac-4bb0-8cc3-7d5a202da02e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:44.755270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71486fc7-68ac-4bb0-8cc3-7d5a202da02e admin admin] PATH_INFO: `/v3/projects/93fb069129cb4909b0eb7cae07c260f8/users/24c705814a4244aa888f90bacab38e4a/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.781201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01b8e7-53cc-4a94-b5bd-a37778622619 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:44.782454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71486fc7-68ac-4bb0-8cc3-7d5a202da02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=93fb069129cb4909b0eb7cae07c260f8, user_id=24c705814a4244aa888f90bacab38e4a, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:44.786800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71486fc7-68ac-4bb0-8cc3-7d5a202da02e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:44.788225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:44.789081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:44.789454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:44.790731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] PATH_INFO: `/v3/users/5e2f0144e6f34d3a995a1431a7812732` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.791228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e2f0144e6f34d3a995a1431a7812732)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:44.794751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:44.798245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:44.813515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 857/1690] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:44 2022] PUT /identity/v3/projects/93fb069129cb4909b0eb7cae07c260f8/users/24c705814a4244aa888f90bacab38e4a/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:48:44.825256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34031aa-4c18-4595-b4e7-29214b174e7d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:44.827135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34031aa-4c18-4595-b4e7-29214b174e7d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:44.828524 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34031aa-4c18-4595-b4e7-29214b174e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:44.885739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e2f0144e6f34d3a995a1431a7812732'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.899937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e34031aa-4c18-4595-b4e7-29214b174e7d None None] MFA Rules not processed for user `24c705814a4244aa888f90bacab38e4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:44.901578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e34031aa-4c18-4595-b4e7-29214b174e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:44.907883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e2f0144e6f34d3a995a1431a7812732'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.908935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e2f0144e6f34d3a995a1431a7812732'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.941223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e2f0144e6f34d3a995a1431a7812732'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.955011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e2f0144e6f34d3a995a1431a7812732'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:44.963713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 834/1691] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:48:44 2022] DELETE /identity/v3/users/5e2f0144e6f34d3a995a1431a7812732 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:45.038972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 858/1692] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:45.043652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:45.046169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:45.267682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287c65a-d29b-4416-bdc5-4c2ba59f032a admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:45.285257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e71654-0a78-4b60-b634-476a4d97710a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:45.286297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71654-0a78-4b60-b634-476a4d97710a admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:45.286417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71654-0a78-4b60-b634-476a4d97710a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:45.286784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e71654-0a78-4b60-b634-476a4d97710a admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:45.287577 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e71654-0a78-4b60-b634-476a4d97710a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:45.293289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e71654-0a78-4b60-b634-476a4d97710a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:45.349071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 835/1693] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:45 2022] POST /identity/v3/projects => generated 379 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:45.352901 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34031aa-4c18-4595-b4e7-29214b174e7d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:45.443259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:45.508230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34031aa-4c18-4595-b4e7-29214b174e7d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:45.677059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59218e27-6c7e-4c85-826a-9b051de8674c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:45.678368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59218e27-6c7e-4c85-826a-9b051de8674c admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:45.679177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59218e27-6c7e-4c85-826a-9b051de8674c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:45.679519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59218e27-6c7e-4c85-826a-9b051de8674c admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:45.680480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59218e27-6c7e-4c85-826a-9b051de8674c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:45.685084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59218e27-6c7e-4c85-826a-9b051de8674c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:45.748045 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 859/1694] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:45 2022] POST /identity/v3/users => generated 296 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:45.749967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e71654-0a78-4b60-b634-476a4d97710a admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:45.772405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e71654-0a78-4b60-b634-476a4d97710a admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:45.785771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6770c-87f4-4b35-aa89-734e1d95fd5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:45.786681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6770c-87f4-4b35-aa89-734e1d95fd5e admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:45.787193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6770c-87f4-4b35-aa89-734e1d95fd5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:45.787581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a6770c-87f4-4b35-aa89-734e1d95fd5e admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:45.788417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6770c-87f4-4b35-aa89-734e1d95fd5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:45.791897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a6770c-87f4-4b35-aa89-734e1d95fd5e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:45.813854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 836/1695] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:48:45.821361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59218e27-6c7e-4c85-826a-9b051de8674c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:45.846119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59218e27-6c7e-4c85-826a-9b051de8674c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:45.862540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d5dca-a929-426d-a097-8842b64efce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:45.863247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5dca-a929-426d-a097-8842b64efce4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:45.863526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5dca-a929-426d-a097-8842b64efce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:45.867931 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d5dca-a929-426d-a097-8842b64efce4 admin admin] PATH_INFO: `/v3/projects/a2f4e8affbd24f02b7cb61da7158dd2e/users/476a0bc38c1943a3b867b34faaa5a4e5/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:45.922392 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d5dca-a929-426d-a097-8842b64efce4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f4e8affbd24f02b7cb61da7158dd2e, user_id=476a0bc38c1943a3b867b34faaa5a4e5, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:45.930961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d5dca-a929-426d-a097-8842b64efce4 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:45.967786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 860/1696] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:45 2022] PUT /identity/v3/projects/a2f4e8affbd24f02b7cb61da7158dd2e/users/476a0bc38c1943a3b867b34faaa5a4e5/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:45.972014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6770c-87f4-4b35-aa89-734e1d95fd5e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:45.989759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a6770c-87f4-4b35-aa89-734e1d95fd5e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:46.100095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:46.113791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cc6ba-8792-43bc-9b64-faf05074a2f8 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:46.114817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cc6ba-8792-43bc-9b64-faf05074a2f8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:46.115327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293cc6ba-8792-43bc-9b64-faf05074a2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:46.139334 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561afb3b-214a-4d27-8a9c-fadffa75b238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:46.140134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561afb3b-214a-4d27-8a9c-fadffa75b238 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:46.140519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561afb3b-214a-4d27-8a9c-fadffa75b238 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:46.140896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561afb3b-214a-4d27-8a9c-fadffa75b238 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:46.141724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561afb3b-214a-4d27-8a9c-fadffa75b238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:46.144267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561afb3b-214a-4d27-8a9c-fadffa75b238 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:46.169312 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 837/1697] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:45 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:46.172284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-293cc6ba-8792-43bc-9b64-faf05074a2f8 None None] MFA Rules not processed for user `50262ab75897467e8342a486ed1fc94e`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:46.173846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561afb3b-214a-4d27-8a9c-fadffa75b238 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:46.180403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-293cc6ba-8792-43bc-9b64-faf05074a2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:46.191371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561afb3b-214a-4d27-8a9c-fadffa75b238 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:46.204556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d14ad-0a7a-4e7c-a524-978cc03f7527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:46.205393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d14ad-0a7a-4e7c-a524-978cc03f7527 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:46.205811 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d14ad-0a7a-4e7c-a524-978cc03f7527 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:46.206206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d14ad-0a7a-4e7c-a524-978cc03f7527 admin admin] PATH_INFO: `/v3/projects/a2f4e8affbd24f02b7cb61da7158dd2e/users/476a0bc38c1943a3b867b34faaa5a4e5/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:46.215017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d14ad-0a7a-4e7c-a524-978cc03f7527 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f4e8affbd24f02b7cb61da7158dd2e, user_id=476a0bc38c1943a3b867b34faaa5a4e5, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:46.218383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283d14ad-0a7a-4e7c-a524-978cc03f7527 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:46.249865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 838/1698] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:46 2022] PUT /identity/v3/projects/a2f4e8affbd24f02b7cb61da7158dd2e/users/476a0bc38c1943a3b867b34faaa5a4e5/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:46.260442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971165-3c02-451c-ad2a-624bc344b9a8 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:46.260872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971165-3c02-451c-ad2a-624bc344b9a8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:46.261393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff971165-3c02-451c-ad2a-624bc344b9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:46.333666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ff971165-3c02-451c-ad2a-624bc344b9a8 None None] MFA Rules not processed for user `476a0bc38c1943a3b867b34faaa5a4e5`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:46.334508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 861/1699] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:46.335792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf9225-e95c-4d12-b0d4-188c4adcfb32 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:46.336079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf9225-e95c-4d12-b0d4-188c4adcfb32 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:46.340717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf9225-e95c-4d12-b0d4-188c4adcfb32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:46.347941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ff971165-3c02-451c-ad2a-624bc344b9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:46.402225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-01bf9225-e95c-4d12-b0d4-188c4adcfb32 None None] MFA Rules not processed for user `fc89c54d75e14107b79c30cabdb91ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:46.403457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-01bf9225-e95c-4d12-b0d4-188c4adcfb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:46.509672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:46.528055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 839/1700] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:46.530103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc0c2c-7181-4025-9db1-36bb07f51634 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:46.530992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc0c2c-7181-4025-9db1-36bb07f51634 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:46.531275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cc0c2c-7181-4025-9db1-36bb07f51634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:46.597719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 862/1701] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:46.599309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf9225-e95c-4d12-b0d4-188c4adcfb32 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:46.607768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-01bf9225-e95c-4d12-b0d4-188c4adcfb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:46.624425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-96cc0c2c-7181-4025-9db1-36bb07f51634 None None] MFA Rules not processed for user `50262ab75897467e8342a486ed1fc94e`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:46.625759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-96cc0c2c-7181-4025-9db1-36bb07f51634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:46.717874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 840/1702] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:46.719836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc0c2c-7181-4025-9db1-36bb07f51634 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:46.722187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-96cc0c2c-7181-4025-9db1-36bb07f51634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:46.771499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf9225-e95c-4d12-b0d4-188c4adcfb32 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:46.782081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:46.784077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:46.784503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:46.785183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] PATH_INFO: `/v3/projects/ce0a1423506e4181866eb445ebf5b180` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:46.804067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce0a1423506e4181866eb445ebf5b180)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:46.806086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:46.870780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cc0c2c-7181-4025-9db1-36bb07f51634 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:46.881664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560cada-dd22-45f1-b0e9-642f63f407d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:46.884513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560cada-dd22-45f1-b0e9-642f63f407d0 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:46.884875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560cada-dd22-45f1-b0e9-642f63f407d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:46.885201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e560cada-dd22-45f1-b0e9-642f63f407d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:46.903740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560cada-dd22-45f1-b0e9-642f63f407d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:46.905583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e560cada-dd22-45f1-b0e9-642f63f407d0 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:46.928737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce0a1423506e4181866eb445ebf5b180', 'request_id': 'req-f28cb302-f361-48c2-a1ca-21c14675b224'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:46.933533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 841/1703] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:46 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:46.936078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560cada-dd22-45f1-b0e9-642f63f407d0 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:46.967630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e560cada-dd22-45f1-b0e9-642f63f407d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:46.979869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce0a1423506e4181866eb445ebf5b180', 'request_id': 'req-f28cb302-f361-48c2-a1ca-21c14675b224'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:47.002058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce0a1423506e4181866eb445ebf5b180', 'request_id': 'req-f28cb302-f361-48c2-a1ca-21c14675b224'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:47.041364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] The token cache is being invalidate because project ce0a1423506e4181866eb445ebf5b180 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:48:47.042813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:47.047060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:47.054422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 863/1704] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:48:46 2022] DELETE /identity/v3/projects/ce0a1423506e4181866eb445ebf5b180 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:47.054422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:47.062581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:47.074564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:47.252160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:47.284163 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28cb302-f361-48c2-a1ca-21c14675b224 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:47.316757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943a0c7f-3615-4985-bc52-8af0beeefa11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:47.317475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0c7f-3615-4985-bc52-8af0beeefa11 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:47.317737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0c7f-3615-4985-bc52-8af0beeefa11 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:47.318014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943a0c7f-3615-4985-bc52-8af0beeefa11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:47.319823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-943a0c7f-3615-4985-bc52-8af0beeefa11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:47.337887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e560cada-dd22-45f1-b0e9-642f63f407d0 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:47.355787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:47.356418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:47.356694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:47.356967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:47.358876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:47.468592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a0c7f-3615-4985-bc52-8af0beeefa11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:47.470391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943a0c7f-3615-4985-bc52-8af0beeefa11 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:47.504247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:47.509031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:47.509233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 864/1705] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:47.510821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfd4a3-95f1-4582-8ef8-01d4749308ad None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:47.511108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfd4a3-95f1-4582-8ef8-01d4749308ad None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:47.511435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccfd4a3-95f1-4582-8ef8-01d4749308ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:47.550725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 842/1706] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:47.553740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:47.558482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:47.562508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-fccfd4a3-95f1-4582-8ef8-01d4749308ad None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:47.570785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fccfd4a3-95f1-4582-8ef8-01d4749308ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:47.722869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693a69b1-d986-43fc-b2b9-9fd23f3dbef3 service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:47.735281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec75c56-b56c-4adc-9ebd-b7994b5b6d3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:47.738872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75c56-b56c-4adc-9ebd-b7994b5b6d3d service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:47.749194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75c56-b56c-4adc-9ebd-b7994b5b6d3d service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:47.749691 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec75c56-b56c-4adc-9ebd-b7994b5b6d3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:47.755813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9ec75c56-b56c-4adc-9ebd-b7994b5b6d3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:47.775493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 865/1707] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:47.777121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78acb94-0d2c-4174-8b03-709418d68a2c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:47.777588 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78acb94-0d2c-4174-8b03-709418d68a2c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:47.777989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78acb94-0d2c-4174-8b03-709418d68a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:47.835715 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d78acb94-0d2c-4174-8b03-709418d68a2c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:47.843674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d78acb94-0d2c-4174-8b03-709418d68a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:47.868869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 866/1708] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:47.869963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78acb94-0d2c-4174-8b03-709418d68a2c None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:47.890399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78acb94-0d2c-4174-8b03-709418d68a2c None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:47.904129 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3510d-4add-4023-a833-9a0330542f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:47.904911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3510d-4add-4023-a833-9a0330542f57 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:47.905692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3510d-4add-4023-a833-9a0330542f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:47.905881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3510d-4add-4023-a833-9a0330542f57 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:47.906647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3510d-4add-4023-a833-9a0330542f57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:48:47.907055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3510d-4add-4023-a833-9a0330542f57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:47.909975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3510d-4add-4023-a833-9a0330542f57 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:47.930562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec75c56-b56c-4adc-9ebd-b7994b5b6d3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:47.932039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec75c56-b56c-4adc-9ebd-b7994b5b6d3d service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:47.944919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 867/1709] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:48:47.945943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3510d-4add-4023-a833-9a0330542f57 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:47.947605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 843/1710] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:47.983024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3510d-4add-4023-a833-9a0330542f57 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:48.014477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ebb9-89a3-47f6-b499-1d793c4bdf4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:48.015344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ebb9-89a3-47f6-b499-1d793c4bdf4d admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:48.015741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ebb9-89a3-47f6-b499-1d793c4bdf4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:48.018244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2ebb9-89a3-47f6-b499-1d793c4bdf4d admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:48.019401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2ebb9-89a3-47f6-b499-1d793c4bdf4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:48.024022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2ebb9-89a3-47f6-b499-1d793c4bdf4d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:48.119726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 868/1711] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:47 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:48.125101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec75c56-b56c-4adc-9ebd-b7994b5b6d3d service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:48.134433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:48.154996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec75c56-b56c-4adc-9ebd-b7994b5b6d3d service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:48.335552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa0cb-fd75-4bbc-b516-fb96af0a0914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:48.336237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa0cb-fd75-4bbc-b516-fb96af0a0914 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:48.336520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa0cb-fd75-4bbc-b516-fb96af0a0914 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:48.336800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa0cb-fd75-4bbc-b516-fb96af0a0914 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:48.337761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfa0cb-fd75-4bbc-b516-fb96af0a0914 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:48.340155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfa0cb-fd75-4bbc-b516-fb96af0a0914 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:48.469663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 844/1712] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:48 2022] POST /identity/v3/users => generated 292 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:48:48.469781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ebb9-89a3-47f6-b499-1d793c4bdf4d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:48.490553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2ebb9-89a3-47f6-b499-1d793c4bdf4d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:48.503769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765899d-9e22-42b2-ab8c-2e1c784bcafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:48.504530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765899d-9e22-42b2-ab8c-2e1c784bcafd admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:48.504938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765899d-9e22-42b2-ab8c-2e1c784bcafd admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:48.505513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a765899d-9e22-42b2-ab8c-2e1c784bcafd admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:48.506196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765899d-9e22-42b2-ab8c-2e1c784bcafd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:48.511798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a765899d-9e22-42b2-ab8c-2e1c784bcafd admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:48.537876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 869/1713] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:48.542523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa0cb-fd75-4bbc-b516-fb96af0a0914 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:48.567873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa0cb-fd75-4bbc-b516-fb96af0a0914 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:48.584374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756098d-80a0-40d8-b4b4-7387214d105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:48.587557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756098d-80a0-40d8-b4b4-7387214d105d admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:48.588053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756098d-80a0-40d8-b4b4-7387214d105d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:48.588556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756098d-80a0-40d8-b4b4-7387214d105d admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:48.591401 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756098d-80a0-40d8-b4b4-7387214d105d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:48.595971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e756098d-80a0-40d8-b4b4-7387214d105d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:48.665147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 845/1714] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:48 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:48.666800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765899d-9e22-42b2-ab8c-2e1c784bcafd admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:48.682105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a765899d-9e22-42b2-ab8c-2e1c784bcafd admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:48.704194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd9b64-9f23-42c9-83d5-360a0d13597c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:48.714394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd9b64-9f23-42c9-83d5-360a0d13597c admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:48.714711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd9b64-9f23-42c9-83d5-360a0d13597c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:48.714997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd9b64-9f23-42c9-83d5-360a0d13597c admin admin] PATH_INFO: `/v3/projects/a86e6055977f430386c223cfaccee466/users/451f78b0c3d24b9084d71e6df332ef79/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:48.767690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd9b64-9f23-42c9-83d5-360a0d13597c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a86e6055977f430386c223cfaccee466, user_id=451f78b0c3d24b9084d71e6df332ef79, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:48.779935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dd9b64-9f23-42c9-83d5-360a0d13597c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:48.821930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 870/1715] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:48 2022] PUT /identity/v3/projects/a86e6055977f430386c223cfaccee466/users/451f78b0c3d24b9084d71e6df332ef79/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:48.834335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc32b-95ab-442e-af3a-f33f0ef8117a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:48.834335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc32b-95ab-442e-af3a-f33f0ef8117a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:48.834335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828dc32b-95ab-442e-af3a-f33f0ef8117a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:48.917535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-828dc32b-95ab-442e-af3a-f33f0ef8117a None None] MFA Rules not processed for user `451f78b0c3d24b9084d71e6df332ef79`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:48.923118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-828dc32b-95ab-442e-af3a-f33f0ef8117a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:49.126710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 846/1716] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:49.127944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd9b64-9f23-42c9-83d5-360a0d13597c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:49.191036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:49.347193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86e08f-d395-4faf-9b60-f39ea20e171f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:49.347550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86e08f-d395-4faf-9b60-f39ea20e171f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:49.347947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a86e08f-d395-4faf-9b60-f39ea20e171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:49.396918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd9b64-9f23-42c9-83d5-360a0d13597c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:49.406823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-1a86e08f-d395-4faf-9b60-f39ea20e171f None None] MFA Rules not processed for user `aac4f2beca334a7f8c62924b5d7e4fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:49.408181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1a86e08f-d395-4faf-9b60-f39ea20e171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:49.425701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ebeb6f-1b49-499b-8845-f575d4440300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:49.427459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebeb6f-1b49-499b-8845-f575d4440300 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:49.427746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebeb6f-1b49-499b-8845-f575d4440300 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:49.428025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebeb6f-1b49-499b-8845-f575d4440300 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:49.428697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebeb6f-1b49-499b-8845-f575d4440300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:49.432493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ebeb6f-1b49-499b-8845-f575d4440300 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:49.565916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 871/1717] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:48:49 2022] POST /identity/v3/projects => generated 383 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:49.573027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c003f7-02b4-42f0-8e14-38a6621db5d2 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:49.573320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c003f7-02b4-42f0-8e14-38a6621db5d2 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:49.573629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c003f7-02b4-42f0-8e14-38a6621db5d2 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:49.579852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 872/1718] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 17 00:48:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:48:49.580767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c003f7-02b4-42f0-8e14-38a6621db5d2 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:49.697794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:49.727075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 847/1719] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:49.728999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0e65-a983-4dcf-9a10-2aed68b79172 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:49.729545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0e65-a983-4dcf-9a10-2aed68b79172 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:49.730023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a0e65-a983-4dcf-9a10-2aed68b79172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:49.840233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c003f7-02b4-42f0-8e14-38a6621db5d2 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:49.853306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7f5a0e65-a983-4dcf-9a10-2aed68b79172 None None] MFA Rules not processed for user `537d07153d3f4adfb3296c4e8e7084bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:49.854247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e71b42a-ec85-4379-a206-2f8541b7e15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:49.854779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71b42a-ec85-4379-a206-2f8541b7e15e admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:49.855862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7f5a0e65-a983-4dcf-9a10-2aed68b79172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:49.857992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71b42a-ec85-4379-a206-2f8541b7e15e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:49.858305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e71b42a-ec85-4379-a206-2f8541b7e15e admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:49.860121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71b42a-ec85-4379-a206-2f8541b7e15e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:49.864759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e71b42a-ec85-4379-a206-2f8541b7e15e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:49.962893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 873/1720] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:48:49 2022] POST /identity/v3/users => generated 298 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:48:49.975777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932681-e977-49f3-9376-4a0a3bfe796f None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:49.976107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932681-e977-49f3-9376-4a0a3bfe796f None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:49.976335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc932681-e977-49f3-9376-4a0a3bfe796f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:50.092962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-fc932681-e977-49f3-9376-4a0a3bfe796f None None] MFA Rules not processed for user `aac4f2beca334a7f8c62924b5d7e4fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:50.103232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fc932681-e977-49f3-9376-4a0a3bfe796f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:50.158040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 848/1721] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:50.162825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a0e65-a983-4dcf-9a10-2aed68b79172 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:50.214746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a0e65-a983-4dcf-9a10-2aed68b79172 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:50.233803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7000-8e65-4f6f-9ef7-e67bb00089c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:50.234453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7000-8e65-4f6f-9ef7-e67bb00089c6 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:50.234743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7000-8e65-4f6f-9ef7-e67bb00089c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:50.235027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e7000-8e65-4f6f-9ef7-e67bb00089c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:50.235696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e7000-8e65-4f6f-9ef7-e67bb00089c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:50.247316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e7000-8e65-4f6f-9ef7-e67bb00089c6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:50.300766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 849/1722] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:50.303879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7000-8e65-4f6f-9ef7-e67bb00089c6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:50.310304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-834e7000-8e65-4f6f-9ef7-e67bb00089c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:50.371498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e7000-8e65-4f6f-9ef7-e67bb00089c6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:50.389900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bddc1-9bf5-4f12-b017-bd7e8da7438c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:50.389900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bddc1-9bf5-4f12-b017-bd7e8da7438c service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:50.389900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bddc1-9bf5-4f12-b017-bd7e8da7438c service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:50.389900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bddc1-9bf5-4f12-b017-bd7e8da7438c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:50.390309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 874/1723] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:49 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 417 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:50.392218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932681-e977-49f3-9376-4a0a3bfe796f None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:50.421508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bddc1-9bf5-4f12-b017-bd7e8da7438c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:50.423409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bddc1-9bf5-4f12-b017-bd7e8da7438c service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:50.429147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc932681-e977-49f3-9376-4a0a3bfe796f None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:50.452393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e34ee-511e-4307-9616-86737c9ead70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:50.456691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e34ee-511e-4307-9616-86737c9ead70 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:50.458406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e34ee-511e-4307-9616-86737c9ead70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:50.459446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e34ee-511e-4307-9616-86737c9ead70 admin admin] PATH_INFO: `/v3/projects/8ece5305b81f40cabc475a83fdd97209/users/749affd9f5624b65837e712f984ef452/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:50.464068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 850/1724] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:50.505908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e34ee-511e-4307-9616-86737c9ead70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ece5305b81f40cabc475a83fdd97209, user_id=749affd9f5624b65837e712f984ef452, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:50.517482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e34ee-511e-4307-9616-86737c9ead70 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:50.580954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 875/1725] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:50 2022] PUT /identity/v3/projects/8ece5305b81f40cabc475a83fdd97209/users/749affd9f5624b65837e712f984ef452/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:50.585519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bddc1-9bf5-4f12-b017-bd7e8da7438c service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:50.593283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e34ee-511e-4307-9616-86737c9ead70 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:50.602048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ab0e34ee-511e-4307-9616-86737c9ead70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:50.607239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bddc1-9bf5-4f12-b017-bd7e8da7438c service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:50.677869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:50.862137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a97d52-710e-417e-ac2f-759874922467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:50.862887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a97d52-710e-417e-ac2f-759874922467 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:50.863063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a97d52-710e-417e-ac2f-759874922467 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:50.863295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a97d52-710e-417e-ac2f-759874922467 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:50.864494 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a97d52-710e-417e-ac2f-759874922467 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:50.874030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a97d52-710e-417e-ac2f-759874922467 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:50.916329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 851/1726] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:48:50 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:48:50.919289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a97d52-710e-417e-ac2f-759874922467 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:50.927294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e34ee-511e-4307-9616-86737c9ead70 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:50.936040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a97d52-710e-417e-ac2f-759874922467 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:50.940138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5445-fe67-400d-a4bf-00dd01d944b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:50.941028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5445-fe67-400d-a4bf-00dd01d944b6 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:50.941308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5445-fe67-400d-a4bf-00dd01d944b6 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:50.941613 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce5445-fe67-400d-a4bf-00dd01d944b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:50.954921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53abb9-7772-4f23-acd6-34388cf80993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:50.956276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53abb9-7772-4f23-acd6-34388cf80993 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:50.956557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53abb9-7772-4f23-acd6-34388cf80993 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:50.956799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53abb9-7772-4f23-acd6-34388cf80993 admin admin] PATH_INFO: `/v3/projects/8ece5305b81f40cabc475a83fdd97209/users/749affd9f5624b65837e712f984ef452/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:50.964317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53abb9-7772-4f23-acd6-34388cf80993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ece5305b81f40cabc475a83fdd97209, user_id=749affd9f5624b65837e712f984ef452, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:50.975319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53abb9-7772-4f23-acd6-34388cf80993 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:51.019633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 852/1727] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:48:50 2022] PUT /identity/v3/projects/8ece5305b81f40cabc475a83fdd97209/users/749affd9f5624b65837e712f984ef452/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:51.022554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a31976-c0e2-4678-abae-6092d38f4078 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:51.024357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a31976-c0e2-4678-abae-6092d38f4078 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:51.024669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a31976-c0e2-4678-abae-6092d38f4078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:51.091882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-60a31976-c0e2-4678-abae-6092d38f4078 None None] MFA Rules not processed for user `749affd9f5624b65837e712f984ef452`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:51.093677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-60a31976-c0e2-4678-abae-6092d38f4078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:51.103967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce5445-fe67-400d-a4bf-00dd01d944b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:51.110506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce5445-fe67-400d-a4bf-00dd01d944b6 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:51.134832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 876/1728] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:51.271235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:51.346264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 853/1729] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:51.354482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5445-fe67-400d-a4bf-00dd01d944b6 service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:51.495127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce5445-fe67-400d-a4bf-00dd01d944b6 service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:51.616061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b2f1d-20b2-412e-ba4c-765d42ce11c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:51.616956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b2f1d-20b2-412e-ba4c-765d42ce11c9 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:51.617240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b2f1d-20b2-412e-ba4c-765d42ce11c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:51.617537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b2f1d-20b2-412e-ba4c-765d42ce11c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:51.675020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:51.819348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b2f1d-20b2-412e-ba4c-765d42ce11c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:51.823854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b2f1d-20b2-412e-ba4c-765d42ce11c9 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:51.844250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceab06b-ebba-43a2-a157-e3ac00dc151f None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:51.844426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceab06b-ebba-43a2-a157-e3ac00dc151f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:51.844640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceab06b-ebba-43a2-a157-e3ac00dc151f None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:51.848866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 854/1730] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 17 00:48:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:48:51.851758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f1285-349b-4a2f-b46d-67689d28bfcc None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:51.852048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f1285-349b-4a2f-b46d-67689d28bfcc None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:51.852665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992f1285-349b-4a2f-b46d-67689d28bfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:51.861704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 877/1731] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:51.894717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-992f1285-349b-4a2f-b46d-67689d28bfcc None None] MFA Rules not processed for user `537d07153d3f4adfb3296c4e8e7084bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:51.895997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-992f1285-349b-4a2f-b46d-67689d28bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:52.023342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 855/1732] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:48:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:52.051361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b2f1d-20b2-412e-ba4c-765d42ce11c9 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:52.064043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b2f1d-20b2-412e-ba4c-765d42ce11c9 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:52.079681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32673b2-870e-4fff-af82-20e6dd04be92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:52.082159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32673b2-870e-4fff-af82-20e6dd04be92 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:52.083013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32673b2-870e-4fff-af82-20e6dd04be92 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:52.087367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32673b2-870e-4fff-af82-20e6dd04be92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:52.138567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32673b2-870e-4fff-af82-20e6dd04be92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:52.141998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32673b2-870e-4fff-af82-20e6dd04be92 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:52.169737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 878/1733] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:52.921086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f1285-349b-4a2f-b46d-67689d28bfcc None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:52.923532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-992f1285-349b-4a2f-b46d-67689d28bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:53.110967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e6c70-49ca-4b16-8dfe-6ba3bdf88919 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:53.111457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e6c70-49ca-4b16-8dfe-6ba3bdf88919 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:53.111544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8e6c70-49ca-4b16-8dfe-6ba3bdf88919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:53.196632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-cc8e6c70-49ca-4b16-8dfe-6ba3bdf88919 None None] MFA Rules not processed for user `9adb6ad92cbf40db90405f8f45a9ae3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:53.202705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-cc8e6c70-49ca-4b16-8dfe-6ba3bdf88919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:53.221759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992f1285-349b-4a2f-b46d-67689d28bfcc None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:53.254085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca635490-242d-45a8-bd9a-c7e23015a459 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:53.255910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca635490-242d-45a8-bd9a-c7e23015a459 service placement] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:53.258197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca635490-242d-45a8-bd9a-c7e23015a459 service placement] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:53.259503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca635490-242d-45a8-bd9a-c7e23015a459 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:53.266275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ca635490-242d-45a8-bd9a-c7e23015a459 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:53.308393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca635490-242d-45a8-bd9a-c7e23015a459 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:53.314383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca635490-242d-45a8-bd9a-c7e23015a459 service placement] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:53.341595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 856/1734] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:53.498643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 879/1735] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 398 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:53.715430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca635490-242d-45a8-bd9a-c7e23015a459 service placement] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:54.048745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca635490-242d-45a8-bd9a-c7e23015a459 service placement] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:54.069470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76a2eb4-be5d-425c-9d9c-e579da2fe215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:54.070937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a2eb4-be5d-425c-9d9c-e579da2fe215 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:54.075136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a2eb4-be5d-425c-9d9c-e579da2fe215 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:54.076163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76a2eb4-be5d-425c-9d9c-e579da2fe215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:54.080306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2f2c4-fd5b-421f-a343-b45ceb1faf32 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:54.081059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2f2c4-fd5b-421f-a343-b45ceb1faf32 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:54.081584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2f2c4-fd5b-421f-a343-b45ceb1faf32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:54.146284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a2eb4-be5d-425c-9d9c-e579da2fe215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:54.150548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76a2eb4-be5d-425c-9d9c-e579da2fe215 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:54.174151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6cb2f2c4-fd5b-421f-a343-b45ceb1faf32 None None] MFA Rules not processed for user `aac4f2beca334a7f8c62924b5d7e4fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:54.175491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6cb2f2c4-fd5b-421f-a343-b45ceb1faf32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:54.187193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 857/1736] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:48:54.387205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 880/1737] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:55.808231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814c99-f146-4c45-8875-4eb586f7b9bc None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:55.808710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814c99-f146-4c45-8875-4eb586f7b9bc None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:55.808950 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12814c99-f146-4c45-8875-4eb586f7b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:55.823865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:55.861937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-12814c99-f146-4c45-8875-4eb586f7b9bc None None] MFA Rules not processed for user `fc89c54d75e14107b79c30cabdb91ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:55.868249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-12814c99-f146-4c45-8875-4eb586f7b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:56.031454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 858/1738] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:57.193071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91243e83-411f-4cb5-b5b9-fe3302e442af None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:57.193635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91243e83-411f-4cb5-b5b9-fe3302e442af None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:57.193738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91243e83-411f-4cb5-b5b9-fe3302e442af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:57.246858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12814c99-f146-4c45-8875-4eb586f7b9bc None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:57.249230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-12814c99-f146-4c45-8875-4eb586f7b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:57.252823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-91243e83-411f-4cb5-b5b9-fe3302e442af None None] MFA Rules not processed for user `e33cf9baa72248739f58cb3a3d7d078b`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:57.254862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-91243e83-411f-4cb5-b5b9-fe3302e442af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:57.336269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:57.434003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 881/1739] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:57.472652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12814c99-f146-4c45-8875-4eb586f7b9bc None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:57.511256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:57.513958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:57.514142 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:57.521925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] PATH_INFO: `/v3/users/24c705814a4244aa888f90bacab38e4a` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:57.533599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c705814a4244aa888f90bacab38e4a)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:57.550789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:57.663931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c705814a4244aa888f90bacab38e4a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:57.684925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c705814a4244aa888f90bacab38e4a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:57.685648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c705814a4244aa888f90bacab38e4a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:57.720782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c705814a4244aa888f90bacab38e4a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:57.742310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c705814a4244aa888f90bacab38e4a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:57.761109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 859/1740] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:48:57 2022] DELETE /identity/v3/users/24c705814a4244aa888f90bacab38e4a => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:48:57.766529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa3164-4397-41f2-9906-20e851902069 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:57.766815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa3164-4397-41f2-9906-20e851902069 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:57.767091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa3164-4397-41f2-9906-20e851902069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:57.804902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-50fa3164-4397-41f2-9906-20e851902069 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:57.809939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-50fa3164-4397-41f2-9906-20e851902069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:58.033773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 882/1741] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:58.069026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:58.069938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:58.118856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:58.174984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6f2f63-d14a-4b31-af8b-4095c9f11402 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:58.181693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c4a4a-b19c-456a-8d56-485d5f0f55a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:58.182324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4a4a-b19c-456a-8d56-485d5f0f55a4 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:58.182597 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4a4a-b19c-456a-8d56-485d5f0f55a4 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:58.182930 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c4a4a-b19c-456a-8d56-485d5f0f55a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:58.185195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2e1c4a4a-b19c-456a-8d56-485d5f0f55a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:58.192626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa3164-4397-41f2-9906-20e851902069 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:58.194650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-50fa3164-4397-41f2-9906-20e851902069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:58.327884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa3164-4397-41f2-9906-20e851902069 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:58.338468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe3377-47ae-487b-af98-1e44820092b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:58.341556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe3377-47ae-487b-af98-1e44820092b1 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:58.342150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe3377-47ae-487b-af98-1e44820092b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:58.342631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fe3377-47ae-487b-af98-1e44820092b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:58.367372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe3377-47ae-487b-af98-1e44820092b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:58.370871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fe3377-47ae-487b-af98-1e44820092b1 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:58.401938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 883/1742] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:48:58.403353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe3377-47ae-487b-af98-1e44820092b1 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:58.407742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f7fe3377-47ae-487b-af98-1e44820092b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:58.421368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c4a4a-b19c-456a-8d56-485d5f0f55a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:58.427185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1c4a4a-b19c-456a-8d56-485d5f0f55a4 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:58.449753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fe3377-47ae-487b-af98-1e44820092b1 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:58.462354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:58.467144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:58.472238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:58.472927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] PATH_INFO: `/v3/users/1c41ee8e1f0e4fd78791d3528e054e2d` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:58.474762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c41ee8e1f0e4fd78791d3528e054e2d)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:58.481910 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:58.498756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 860/1743] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:58.555795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658a564-f397-4cbb-9c65-9f71d446fb7f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:58.556914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658a564-f397-4cbb-9c65-9f71d446fb7f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:58.557633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2658a564-f397-4cbb-9c65-9f71d446fb7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:58.596483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c41ee8e1f0e4fd78791d3528e054e2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:58.617867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c41ee8e1f0e4fd78791d3528e054e2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:58.618988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c41ee8e1f0e4fd78791d3528e054e2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:58.635188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c41ee8e1f0e4fd78791d3528e054e2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:58.662109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:58.672240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-259cf0fc-ba53-4bf7-a491-04a90f64d6e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c41ee8e1f0e4fd78791d3528e054e2d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:48:58.688914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 884/1744] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:48:58 2022] DELETE /identity/v3/users/1c41ee8e1f0e4fd78791d3528e054e2d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:48:58.693690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2f22b-dbf2-49e8-b1e7-0b916a02f439 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:58.694510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2f22b-dbf2-49e8-b1e7-0b916a02f439 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:58.695589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d2f22b-dbf2-49e8-b1e7-0b916a02f439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:58.724043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2658a564-f397-4cbb-9c65-9f71d446fb7f None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:58.725686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2658a564-f397-4cbb-9c65-9f71d446fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:58.745631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-84d2f22b-dbf2-49e8-b1e7-0b916a02f439 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:48:58.748202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-84d2f22b-dbf2-49e8-b1e7-0b916a02f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:58.909345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 885/1745] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:48:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:48:58.984224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2f22b-dbf2-49e8-b1e7-0b916a02f439 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:58.985956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-84d2f22b-dbf2-49e8-b1e7-0b916a02f439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:58.995428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 861/1746] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:48:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:48:59.182814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d2f22b-dbf2-49e8-b1e7-0b916a02f439 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:59.189212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043af93-8120-4bc9-a57d-1ca643915bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:59.189986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043af93-8120-4bc9-a57d-1ca643915bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:59.190367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043af93-8120-4bc9-a57d-1ca643915bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:59.190738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9043af93-8120-4bc9-a57d-1ca643915bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:59.214284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043af93-8120-4bc9-a57d-1ca643915bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:59.216014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9043af93-8120-4bc9-a57d-1ca643915bc9 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:59.233313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658a564-f397-4cbb-9c65-9f71d446fb7f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:59.233760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 886/1747] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:48:59.234913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2658a564-f397-4cbb-9c65-9f71d446fb7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:59.355423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:48:59.378062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043af93-8120-4bc9-a57d-1ca643915bc9 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:48:59.380803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9043af93-8120-4bc9-a57d-1ca643915bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:59.397897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2658a564-f397-4cbb-9c65-9f71d446fb7f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:59.407423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:59.408863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:59.409729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:59.409927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:59.417284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:48:59.568536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:59.571327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:59.602358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 862/1748] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:48:59 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:48:59.656500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9043af93-8120-4bc9-a57d-1ca643915bc9 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:48:59.667132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b013-8614-4722-8b91-502b8e8a506c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:48:59.667766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b013-8614-4722-8b91-502b8e8a506c service swift] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:48:59.668052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b013-8614-4722-8b91-502b8e8a506c service swift] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:48:59.668322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810b013-8614-4722-8b91-502b8e8a506c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:48:59.691755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810b013-8614-4722-8b91-502b8e8a506c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:48:59.693859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c810b013-8614-4722-8b91-502b8e8a506c service swift] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:48:59.730669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 887/1749] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:48:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 00:49:01.944145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:01.948010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:01.985876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e56b441-e36d-4ce8-bfda-d951b0ba3fc1 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:02.015341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:02.015915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:02.016200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:02.016477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] PATH_INFO: `/v3/projects/93fb069129cb4909b0eb7cae07c260f8` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:02.030557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93fb069129cb4909b0eb7cae07c260f8)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:02.032562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:02.305483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93fb069129cb4909b0eb7cae07c260f8', 'request_id': 'req-b1995538-68c8-4375-8bb2-171f7e9bc6f1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:02.356070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93fb069129cb4909b0eb7cae07c260f8', 'request_id': 'req-b1995538-68c8-4375-8bb2-171f7e9bc6f1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:02.356746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b013-8614-4722-8b91-502b8e8a506c service swift] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:02.358238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c810b013-8614-4722-8b91-502b8e8a506c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:02.383456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:02.384942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93fb069129cb4909b0eb7cae07c260f8', 'request_id': 'req-b1995538-68c8-4375-8bb2-171f7e9bc6f1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:02.407047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810b013-8614-4722-8b91-502b8e8a506c service swift] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:02.459485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] The token cache is being invalidate because project 93fb069129cb4909b0eb7cae07c260f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:02.463749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:02.471215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:02.479917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 863/1750] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:01 2022] DELETE /identity/v3/projects/93fb069129cb4909b0eb7cae07c260f8 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:02.485490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:02.491798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:02.756453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:02.772637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:02.775193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:02.778805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] PATH_INFO: `/v3/projects/109a02e582ad4d1aa61f468ae7a113c3` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:02.782941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=109a02e582ad4d1aa61f468ae7a113c3)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:02.810823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:02.821800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1995538-68c8-4375-8bb2-171f7e9bc6f1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:02.842263 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:02.842490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:02.842754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:02.843029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] PATH_INFO: `/v3/users/476a0bc38c1943a3b867b34faaa5a4e5` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:02.849798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476a0bc38c1943a3b867b34faaa5a4e5)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:02.863075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:02.884246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:02.948156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '109a02e582ad4d1aa61f468ae7a113c3', 'request_id': 'req-820e5ae8-2c8e-4396-97fd-28a41867a58b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:02.963192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '109a02e582ad4d1aa61f468ae7a113c3', 'request_id': 'req-820e5ae8-2c8e-4396-97fd-28a41867a58b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:02.971935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '109a02e582ad4d1aa61f468ae7a113c3', 'request_id': 'req-820e5ae8-2c8e-4396-97fd-28a41867a58b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:03.015487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476a0bc38c1943a3b867b34faaa5a4e5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:03.034134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476a0bc38c1943a3b867b34faaa5a4e5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:03.037357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476a0bc38c1943a3b867b34faaa5a4e5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:03.059603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] The token cache is being invalidate because project 109a02e582ad4d1aa61f468ae7a113c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:03.059828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:03.063112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-820e5ae8-2c8e-4396-97fd-28a41867a58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:03.065694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 888/1751] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:02 2022] DELETE /identity/v3/projects/109a02e582ad4d1aa61f468ae7a113c3 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:03.074883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476a0bc38c1943a3b867b34faaa5a4e5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:03.079030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a964f7-1e5f-4f34-b58d-02c03ef374e6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:03.079401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a964f7-1e5f-4f34-b58d-02c03ef374e6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:03.079731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a964f7-1e5f-4f34-b58d-02c03ef374e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:03.090908 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-56860a67-a618-4bd8-bce8-47d8f14ae475 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476a0bc38c1943a3b867b34faaa5a4e5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:03.104563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 864/1752] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:02 2022] DELETE /identity/v3/users/476a0bc38c1943a3b867b34faaa5a4e5 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:03.107055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ce79-c2ef-40bc-8d0a-062201aa228a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:03.107448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ce79-c2ef-40bc-8d0a-062201aa228a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:03.111325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e17ce79-c2ef-40bc-8d0a-062201aa228a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:03.150580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-89a964f7-1e5f-4f34-b58d-02c03ef374e6 None None] MFA Rules not processed for user `9adb6ad92cbf40db90405f8f45a9ae3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:03.151831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-89a964f7-1e5f-4f34-b58d-02c03ef374e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:03.158238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2e17ce79-c2ef-40bc-8d0a-062201aa228a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:03.159145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2e17ce79-c2ef-40bc-8d0a-062201aa228a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:03.316743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 889/1753] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:03.352069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0295a-f74c-4a9f-92d8-702813351fac None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:03.352345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0295a-f74c-4a9f-92d8-702813351fac None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:03.352640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0295a-f74c-4a9f-92d8-702813351fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:03.355975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 865/1754] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:03.403627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d9f0295a-f74c-4a9f-92d8-702813351fac None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:03.406222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d9f0295a-f74c-4a9f-92d8-702813351fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:03.432588 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 890/1755] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:03.438137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17ce79-c2ef-40bc-8d0a-062201aa228a None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:03.459216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e17ce79-c2ef-40bc-8d0a-062201aa228a None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:03.464567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a200760-90d4-4da1-8343-724200578f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:03.465213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a200760-90d4-4da1-8343-724200578f71 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:03.465533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a200760-90d4-4da1-8343-724200578f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:03.465815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a200760-90d4-4da1-8343-724200578f71 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:03.466483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a200760-90d4-4da1-8343-724200578f71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:03.466792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a200760-90d4-4da1-8343-724200578f71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:03.468425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a200760-90d4-4da1-8343-724200578f71 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:03.490543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0295a-f74c-4a9f-92d8-702813351fac None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:03.497760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 866/1756] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:03.502710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0295a-f74c-4a9f-92d8-702813351fac None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:03.523629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dc2573-544c-44ad-ad42-e41c509c557b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:03.524489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc2573-544c-44ad-ad42-e41c509c557b admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:03.525121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc2573-544c-44ad-ad42-e41c509c557b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:03.525459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dc2573-544c-44ad-ad42-e41c509c557b admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:03.527821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc2573-544c-44ad-ad42-e41c509c557b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:03.529828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dc2573-544c-44ad-ad42-e41c509c557b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:03.616357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a200760-90d4-4da1-8343-724200578f71 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:03.617054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 891/1757] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:03 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:03.628876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a200760-90d4-4da1-8343-724200578f71 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:03.825154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7264a-03c4-4404-9714-32641feb412d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:03.825503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7264a-03c4-4404-9714-32641feb412d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:03.825893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d7264a-03c4-4404-9714-32641feb412d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:03.887268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9a98c-62cf-49b2-b348-aa717f57eee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:03.887918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9a98c-62cf-49b2-b348-aa717f57eee7 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:03.888206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9a98c-62cf-49b2-b348-aa717f57eee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:03.888918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f9a98c-62cf-49b2-b348-aa717f57eee7 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:03.889240 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9a98c-62cf-49b2-b348-aa717f57eee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:03.898293 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-13d7264a-03c4-4404-9714-32641feb412d None None] MFA Rules not processed for user `537d07153d3f4adfb3296c4e8e7084bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:03.899640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-13d7264a-03c4-4404-9714-32641feb412d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:03.901966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f9a98c-62cf-49b2-b348-aa717f57eee7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:03.924639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:04.003323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 867/1758] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:03 2022] POST /identity/v3/users => generated 287 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:04.009127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9a98c-62cf-49b2-b348-aa717f57eee7 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:04.038449 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f9a98c-62cf-49b2-b348-aa717f57eee7 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:04.047477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 892/1759] 10.222.0.20 () {58 vars in 1015 bytes} [Sat Sep 17 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:04.089591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcb42e-3035-4551-a13c-73d1c8ca4bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:04.092579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb42e-3035-4551-a13c-73d1c8ca4bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:04.092875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb42e-3035-4551-a13c-73d1c8ca4bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:04.093390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fcb42e-3035-4551-a13c-73d1c8ca4bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:04.097966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcb42e-3035-4551-a13c-73d1c8ca4bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:04.107375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fcb42e-3035-4551-a13c-73d1c8ca4bc8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:04.109756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:04.123425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7264a-03c4-4404-9714-32641feb412d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:04.125479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-13d7264a-03c4-4404-9714-32641feb412d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:04.145899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d7264a-03c4-4404-9714-32641feb412d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:04.154251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90361edc-2cfa-460f-96c2-ff356b470adc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:04.158608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90361edc-2cfa-460f-96c2-ff356b470adc service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:04.158935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90361edc-2cfa-460f-96c2-ff356b470adc service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:04.159269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90361edc-2cfa-460f-96c2-ff356b470adc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:04.166994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 868/1760] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:04.171886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcb42e-3035-4551-a13c-73d1c8ca4bc8 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:04.186254 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90361edc-2cfa-460f-96c2-ff356b470adc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:04.191440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90361edc-2cfa-460f-96c2-ff356b470adc service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:04.206505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fcb42e-3035-4551-a13c-73d1c8ca4bc8 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:04.217179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 893/1761] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:04.232462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0ad1d-11cd-4c4c-b34d-1fc5953eaaf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:04.235913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0ad1d-11cd-4c4c-b34d-1fc5953eaaf6 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:04.236993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0ad1d-11cd-4c4c-b34d-1fc5953eaaf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:04.239903 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0ad1d-11cd-4c4c-b34d-1fc5953eaaf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:04.240645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0ad1d-11cd-4c4c-b34d-1fc5953eaaf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:04.259949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0ad1d-11cd-4c4c-b34d-1fc5953eaaf6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:04.333619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 869/1762] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:04 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:04.339049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90361edc-2cfa-460f-96c2-ff356b470adc service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:04.360454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90361edc-2cfa-460f-96c2-ff356b470adc service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:04.365810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0ad1d-11cd-4c4c-b34d-1fc5953eaaf6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:04.369578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2bf0ad1d-11cd-4c4c-b34d-1fc5953eaaf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:04.375814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf14848-73f4-405d-a3c2-5fd719851f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:04.376616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf14848-73f4-405d-a3c2-5fd719851f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:04.377019 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf14848-73f4-405d-a3c2-5fd719851f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:04.377385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf14848-73f4-405d-a3c2-5fd719851f9d admin admin] PATH_INFO: `/v3/projects/b1d77737b78344a5b179ec09312bf4f7/users/bdf9bccc62a3409991a6f6a52725ccaa/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:04.411647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0ad1d-11cd-4c4c-b34d-1fc5953eaaf6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:04.439799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf14848-73f4-405d-a3c2-5fd719851f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1d77737b78344a5b179ec09312bf4f7, user_id=bdf9bccc62a3409991a6f6a52725ccaa, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:04.453668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf14848-73f4-405d-a3c2-5fd719851f9d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:04.464583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:04.465330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:04.465644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:04.477065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] PATH_INFO: `/v3/projects/a2f4e8affbd24f02b7cb61da7158dd2e` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:04.485556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f4e8affbd24f02b7cb61da7158dd2e)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:04.493940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:04.521665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 894/1763] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:04 2022] PUT /identity/v3/projects/b1d77737b78344a5b179ec09312bf4f7/users/bdf9bccc62a3409991a6f6a52725ccaa/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:04.524365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c1454-2670-498f-baf2-6cbfbc9d65e3 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:04.525066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c1454-2670-498f-baf2-6cbfbc9d65e3 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:04.525600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44c1454-2670-498f-baf2-6cbfbc9d65e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:04.611267 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b44c1454-2670-498f-baf2-6cbfbc9d65e3 None None] MFA Rules not processed for user `bdf9bccc62a3409991a6f6a52725ccaa`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:04.616872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b44c1454-2670-498f-baf2-6cbfbc9d65e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:04.686436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f4e8affbd24f02b7cb61da7158dd2e', 'request_id': 'req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:04.717043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f4e8affbd24f02b7cb61da7158dd2e', 'request_id': 'req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:04.732959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f4e8affbd24f02b7cb61da7158dd2e', 'request_id': 'req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:04.766710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] The token cache is being invalidate because project a2f4e8affbd24f02b7cb61da7158dd2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:04.766953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:04.770315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b80ee3a3-6c03-4b8f-b7ec-0af41ab9bb2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:04.774526 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 870/1764] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:04 2022] DELETE /identity/v3/projects/a2f4e8affbd24f02b7cb61da7158dd2e => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:04.779177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6208a-8a50-46d5-a9ce-7aef21cadc32 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:04.779476 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6208a-8a50-46d5-a9ce-7aef21cadc32 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:04.779735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6208a-8a50-46d5-a9ce-7aef21cadc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:04.840315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-98b6208a-8a50-46d5-a9ce-7aef21cadc32 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:04.841600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-98b6208a-8a50-46d5-a9ce-7aef21cadc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:04.876997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 895/1765] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:04.879462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c1454-2670-498f-baf2-6cbfbc9d65e3 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:04.882391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b44c1454-2670-498f-baf2-6cbfbc9d65e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:05.020380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 871/1766] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:05.022172 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ad006-435a-4b8d-b45d-8c33a62e32df None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.023616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ad006-435a-4b8d-b45d-8c33a62e32df None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.026028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186ad006-435a-4b8d-b45d-8c33a62e32df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.081283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-186ad006-435a-4b8d-b45d-8c33a62e32df None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:05.084245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-186ad006-435a-4b8d-b45d-8c33a62e32df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:05.108421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 872/1767] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:05.112810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ad006-435a-4b8d-b45d-8c33a62e32df None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.130278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186ad006-435a-4b8d-b45d-8c33a62e32df None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.147965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73da616-99ea-4bea-b9b3-5a4ec4d7141f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.150652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73da616-99ea-4bea-b9b3-5a4ec4d7141f admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.151089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73da616-99ea-4bea-b9b3-5a4ec4d7141f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.151210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73da616-99ea-4bea-b9b3-5a4ec4d7141f admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.164054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73da616-99ea-4bea-b9b3-5a4ec4d7141f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:05.164054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73da616-99ea-4bea-b9b3-5a4ec4d7141f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.164054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73da616-99ea-4bea-b9b3-5a4ec4d7141f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.169426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44c1454-2670-498f-baf2-6cbfbc9d65e3 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.177055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edc91-4089-45a5-a74b-d6c081857753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.179560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edc91-4089-45a5-a74b-d6c081857753 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.180667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edc91-4089-45a5-a74b-d6c081857753 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.181436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34edc91-4089-45a5-a74b-d6c081857753 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.182890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34edc91-4089-45a5-a74b-d6c081857753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.188044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34edc91-4089-45a5-a74b-d6c081857753 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.198031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 873/1768] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:05.199022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73da616-99ea-4bea-b9b3-5a4ec4d7141f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.221906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73da616-99ea-4bea-b9b3-5a4ec4d7141f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.233865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b953d4-db68-410f-a5eb-e7270a3d4f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.234823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b953d4-db68-410f-a5eb-e7270a3d4f7f admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.235109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b953d4-db68-410f-a5eb-e7270a3d4f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.235382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b953d4-db68-410f-a5eb-e7270a3d4f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.236039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b953d4-db68-410f-a5eb-e7270a3d4f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.238173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b953d4-db68-410f-a5eb-e7270a3d4f7f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.246592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:05.280862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 874/1769] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:05 2022] POST /identity/v3/projects => generated 369 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:05.287227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b953d4-db68-410f-a5eb-e7270a3d4f7f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.289077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 896/1770] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:04 2022] POST /identity/v3/projects => generated 371 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:05.290560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edc91-4089-45a5-a74b-d6c081857753 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.331377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:05.397103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34edc91-4089-45a5-a74b-d6c081857753 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.403932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb871c-38d7-46d1-a4c0-69b2911e4855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.404814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb871c-38d7-46d1-a4c0-69b2911e4855 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.405218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb871c-38d7-46d1-a4c0-69b2911e4855 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.406140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb871c-38d7-46d1-a4c0-69b2911e4855 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.407229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb871c-38d7-46d1-a4c0-69b2911e4855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.409457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eb871c-38d7-46d1-a4c0-69b2911e4855 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.453132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b953d4-db68-410f-a5eb-e7270a3d4f7f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.480189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63f4e-bbcd-4da5-a7ce-f70c975c1731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.482588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63f4e-bbcd-4da5-a7ce-f70c975c1731 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.483526 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63f4e-bbcd-4da5-a7ce-f70c975c1731 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.484273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b63f4e-bbcd-4da5-a7ce-f70c975c1731 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.485471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b63f4e-bbcd-4da5-a7ce-f70c975c1731 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.488591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b63f4e-bbcd-4da5-a7ce-f70c975c1731 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.507258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 897/1771] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:05 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:05.514215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb871c-38d7-46d1-a4c0-69b2911e4855 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.550054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 875/1772] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:05 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:05.552573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63f4e-bbcd-4da5-a7ce-f70c975c1731 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.555774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb871c-38d7-46d1-a4c0-69b2911e4855 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.569102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b63f4e-bbcd-4da5-a7ce-f70c975c1731 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.570312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320c1ab-e41e-4fed-b2a7-bcf440938518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.571146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320c1ab-e41e-4fed-b2a7-bcf440938518 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.571436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320c1ab-e41e-4fed-b2a7-bcf440938518 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.571711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d320c1ab-e41e-4fed-b2a7-bcf440938518 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.572427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320c1ab-e41e-4fed-b2a7-bcf440938518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.574504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d320c1ab-e41e-4fed-b2a7-bcf440938518 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.575004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020d5a1-380f-4278-95ab-7caa4ff9734a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.575728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d5a1-380f-4278-95ab-7caa4ff9734a admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.576077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d5a1-380f-4278-95ab-7caa4ff9734a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.576420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7020d5a1-380f-4278-95ab-7caa4ff9734a admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.577567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020d5a1-380f-4278-95ab-7caa4ff9734a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.581108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7020d5a1-380f-4278-95ab-7caa4ff9734a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.591802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 898/1773] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:05.596923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320c1ab-e41e-4fed-b2a7-bcf440938518 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.599952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 876/1774] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:05.600988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020d5a1-380f-4278-95ab-7caa4ff9734a admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.616810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7020d5a1-380f-4278-95ab-7caa4ff9734a admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.625783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d820-bef7-4675-a867-47f8d841f0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.626525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d820-bef7-4675-a867-47f8d841f0f8 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.626873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d820-bef7-4675-a867-47f8d841f0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.627255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba79d820-bef7-4675-a867-47f8d841f0f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.628011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79d820-bef7-4675-a867-47f8d841f0f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.630868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba79d820-bef7-4675-a867-47f8d841f0f8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.650568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 877/1775] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:05.655064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d820-bef7-4675-a867-47f8d841f0f8 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.666539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d320c1ab-e41e-4fed-b2a7-bcf440938518 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.667851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba79d820-bef7-4675-a867-47f8d841f0f8 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:05.678834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340fe3d3-f070-4244-acd9-1c9a52476db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.679994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fe3d3-f070-4244-acd9-1c9a52476db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.681226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fe3d3-f070-4244-acd9-1c9a52476db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.681640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340fe3d3-f070-4244-acd9-1c9a52476db0 admin admin] PATH_INFO: `/v3/projects/74cbbd9a30c148449e47b9164b5b4771/users/110af205a2e149a39d0c14247d4c21a9/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.690258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b99472-9c18-445e-84e4-2809dd380f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:05.697185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b99472-9c18-445e-84e4-2809dd380f2e admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.697574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b99472-9c18-445e-84e4-2809dd380f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.697902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b99472-9c18-445e-84e4-2809dd380f2e admin admin] PATH_INFO: `/v3/projects/0209b0eee0ff4334bf8a1af7f9e703e0/users/59b7e68906eb435581b62949589cd7bd/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.737485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fe3d3-f070-4244-acd9-1c9a52476db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74cbbd9a30c148449e47b9164b5b4771, user_id=110af205a2e149a39d0c14247d4c21a9, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.756141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340fe3d3-f070-4244-acd9-1c9a52476db0 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.789710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b99472-9c18-445e-84e4-2809dd380f2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0209b0eee0ff4334bf8a1af7f9e703e0, user_id=59b7e68906eb435581b62949589cd7bd, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:05.810108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b99472-9c18-445e-84e4-2809dd380f2e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:05.825763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 878/1776] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:05 2022] PUT /identity/v3/projects/74cbbd9a30c148449e47b9164b5b4771/users/110af205a2e149a39d0c14247d4c21a9/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:05.844998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832d70-b6e6-4654-8b18-267faf52431e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:05.846718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832d70-b6e6-4654-8b18-267faf52431e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:05.846718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a832d70-b6e6-4654-8b18-267faf52431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:05.871495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 899/1777] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:05 2022] PUT /identity/v3/projects/0209b0eee0ff4334bf8a1af7f9e703e0/users/59b7e68906eb435581b62949589cd7bd/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:05.875691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b99472-9c18-445e-84e4-2809dd380f2e admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:05.981926 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3a832d70-b6e6-4654-8b18-267faf52431e None None] MFA Rules not processed for user `110af205a2e149a39d0c14247d4c21a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:05.986069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3a832d70-b6e6-4654-8b18-267faf52431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:06.128273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b99472-9c18-445e-84e4-2809dd380f2e admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:06.137515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ccc91-1a45-419d-b96b-5b2c22f6a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:06.138829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ccc91-1a45-419d-b96b-5b2c22f6a833 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:06.139262 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ccc91-1a45-419d-b96b-5b2c22f6a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:06.139946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ccc91-1a45-419d-b96b-5b2c22f6a833 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:06.141078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ccc91-1a45-419d-b96b-5b2c22f6a833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:06.143364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ccc91-1a45-419d-b96b-5b2c22f6a833 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:06.164205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 900/1778] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:05 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:06.166383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ccc91-1a45-419d-b96b-5b2c22f6a833 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:06.185203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ccc91-1a45-419d-b96b-5b2c22f6a833 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:06.193538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea31690-d9e1-4b15-8f90-99c9c7b26764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:06.194620 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31690-d9e1-4b15-8f90-99c9c7b26764 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:06.195479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31690-d9e1-4b15-8f90-99c9c7b26764 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:06.195965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea31690-d9e1-4b15-8f90-99c9c7b26764 admin admin] PATH_INFO: `/v3/projects/0209b0eee0ff4334bf8a1af7f9e703e0/users/59b7e68906eb435581b62949589cd7bd/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:06.199523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea31690-d9e1-4b15-8f90-99c9c7b26764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0209b0eee0ff4334bf8a1af7f9e703e0, user_id=59b7e68906eb435581b62949589cd7bd, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:06.203530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 879/1779] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 360 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:06.204775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea31690-d9e1-4b15-8f90-99c9c7b26764 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:06.215821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a832d70-b6e6-4654-8b18-267faf52431e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:06.227684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 901/1780] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:06 2022] PUT /identity/v3/projects/0209b0eee0ff4334bf8a1af7f9e703e0/users/59b7e68906eb435581b62949589cd7bd/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:06.243869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672db7f-3480-4a7d-868f-13ab5674beb4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:06.245966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672db7f-3480-4a7d-868f-13ab5674beb4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:06.245966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672db7f-3480-4a7d-868f-13ab5674beb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:06.255638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a832d70-b6e6-4654-8b18-267faf52431e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:06.322699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6672db7f-3480-4a7d-868f-13ab5674beb4 None None] MFA Rules not processed for user `59b7e68906eb435581b62949589cd7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:06.324057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6672db7f-3480-4a7d-868f-13ab5674beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:06.380002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:06.428649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d488b-f265-4a9d-9fa1-15f0c2fdbfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:06.429286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d488b-f265-4a9d-9fa1-15f0c2fdbfa6 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:06.429593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d488b-f265-4a9d-9fa1-15f0c2fdbfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:06.429870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783d488b-f265-4a9d-9fa1-15f0c2fdbfa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:06.432038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d488b-f265-4a9d-9fa1-15f0c2fdbfa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:06.432915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783d488b-f265-4a9d-9fa1-15f0c2fdbfa6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:06.449307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:06.490834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 880/1781] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:06 2022] POST /identity/v3/projects => generated 367 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:06.494644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d488b-f265-4a9d-9fa1-15f0c2fdbfa6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:06.579767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 902/1782] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:06.605189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672db7f-3480-4a7d-868f-13ab5674beb4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:06.608209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6672db7f-3480-4a7d-868f-13ab5674beb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:06.669073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783d488b-f265-4a9d-9fa1-15f0c2fdbfa6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:06.682234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e509-d57c-4203-a79d-5cb69d6194cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:06.685260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e509-d57c-4203-a79d-5cb69d6194cd admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:06.685260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e509-d57c-4203-a79d-5cb69d6194cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:06.685260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f3e509-d57c-4203-a79d-5cb69d6194cd admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:06.692106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3e509-d57c-4203-a79d-5cb69d6194cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:06.694826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f3e509-d57c-4203-a79d-5cb69d6194cd admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:06.779083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672db7f-3480-4a7d-868f-13ab5674beb4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:06.789470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 881/1783] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:06 2022] POST /identity/v3/users => generated 290 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:06.801699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e509-d57c-4203-a79d-5cb69d6194cd admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:06.814486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f3e509-d57c-4203-a79d-5cb69d6194cd admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:06.820295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b62de9-f186-4fdc-a506-4b61fbda6368 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:06.821642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62de9-f186-4fdc-a506-4b61fbda6368 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:06.822174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62de9-f186-4fdc-a506-4b61fbda6368 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:06.822521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b62de9-f186-4fdc-a506-4b61fbda6368 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:06.823512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b62de9-f186-4fdc-a506-4b61fbda6368 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:06.825794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b62de9-f186-4fdc-a506-4b61fbda6368 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:06.855631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 882/1784] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:06 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:06.857329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b62de9-f186-4fdc-a506-4b61fbda6368 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:06.871276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b62de9-f186-4fdc-a506-4b61fbda6368 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:06.890341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298683f-8639-4692-8ee1-83696fbfeb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:06.891315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298683f-8639-4692-8ee1-83696fbfeb8b admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:06.891775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298683f-8639-4692-8ee1-83696fbfeb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:06.892219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298683f-8639-4692-8ee1-83696fbfeb8b admin admin] PATH_INFO: `/v3/projects/70ffd530063e429dbe4ed37742f1931d/users/9c8ca9e1b38b4291b36b9750f86e9266/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:06.914657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb4892-eebf-4bdd-9a46-a126a6f62590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:06.915089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298683f-8639-4692-8ee1-83696fbfeb8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ffd530063e429dbe4ed37742f1931d, user_id=9c8ca9e1b38b4291b36b9750f86e9266, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:06.915630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb4892-eebf-4bdd-9a46-a126a6f62590 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:06.916064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb4892-eebf-4bdd-9a46-a126a6f62590 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:06.916512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb4892-eebf-4bdd-9a46-a126a6f62590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:06.923809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8298683f-8639-4692-8ee1-83696fbfeb8b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:06.948760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 883/1785] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:06 2022] PUT /identity/v3/projects/70ffd530063e429dbe4ed37742f1931d/users/9c8ca9e1b38b4291b36b9750f86e9266/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:06.950337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298683f-8639-4692-8ee1-83696fbfeb8b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:06.952962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8298683f-8639-4692-8ee1-83696fbfeb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:07.086654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb4892-eebf-4bdd-9a46-a126a6f62590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:07.092186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb4892-eebf-4bdd-9a46-a126a6f62590 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:07.111351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8298683f-8639-4692-8ee1-83696fbfeb8b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:07.131661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 903/1786] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:06 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:07.132644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb4892-eebf-4bdd-9a46-a126a6f62590 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:07.136450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:07.144053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:07.147457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:07.147775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] PATH_INFO: `/v3/users/451f78b0c3d24b9084d71e6df332ef79` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:07.154122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] RBAC: Authorizing `identity:delete_user(user_id=451f78b0c3d24b9084d71e6df332ef79)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:07.162682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:07.172213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb4892-eebf-4bdd-9a46-a126a6f62590 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:07.198711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e439e8a-0bc5-49db-918a-1e32125614b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:07.199513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e439e8a-0bc5-49db-918a-1e32125614b1 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:07.199885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e439e8a-0bc5-49db-918a-1e32125614b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:07.200060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e439e8a-0bc5-49db-918a-1e32125614b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:07.200719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e439e8a-0bc5-49db-918a-1e32125614b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:07.205341 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e439e8a-0bc5-49db-918a-1e32125614b1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:07.240010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 904/1787] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:07 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:07.242178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e439e8a-0bc5-49db-918a-1e32125614b1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:07.288096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e439e8a-0bc5-49db-918a-1e32125614b1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:07.299444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:07.310433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186d6c4-cce1-49cf-97e0-9e8e88111ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:07.311898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451f78b0c3d24b9084d71e6df332ef79'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:07.312515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186d6c4-cce1-49cf-97e0-9e8e88111ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:07.314094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186d6c4-cce1-49cf-97e0-9e8e88111ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:07.314514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a186d6c4-cce1-49cf-97e0-9e8e88111ca7 admin admin] PATH_INFO: `/v3/projects/70ffd530063e429dbe4ed37742f1931d/users/9c8ca9e1b38b4291b36b9750f86e9266/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:07.329000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186d6c4-cce1-49cf-97e0-9e8e88111ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70ffd530063e429dbe4ed37742f1931d, user_id=9c8ca9e1b38b4291b36b9750f86e9266, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:07.329295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451f78b0c3d24b9084d71e6df332ef79'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:07.330440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451f78b0c3d24b9084d71e6df332ef79'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:07.332580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a186d6c4-cce1-49cf-97e0-9e8e88111ca7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:07.360088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:07.363722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451f78b0c3d24b9084d71e6df332ef79'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:07.378285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 905/1788] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:07 2022] PUT /identity/v3/projects/70ffd530063e429dbe4ed37742f1931d/users/9c8ca9e1b38b4291b36b9750f86e9266/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:07.380370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186d6c4-cce1-49cf-97e0-9e8e88111ca7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:07.385843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a186d6c4-cce1-49cf-97e0-9e8e88111ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:07.394404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d7af6224-668d-4e68-9f47-2676a0e966be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451f78b0c3d24b9084d71e6df332ef79'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:07.412430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 884/1789] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:06 2022] DELETE /identity/v3/users/451f78b0c3d24b9084d71e6df332ef79 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:07.418325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41def39-6603-415d-9407-eb23a3c0208c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:07.419067 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41def39-6603-415d-9407-eb23a3c0208c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:07.419346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41def39-6603-415d-9407-eb23a3c0208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:07.512822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-c41def39-6603-415d-9407-eb23a3c0208c None None] MFA Rules not processed for user `9c8ca9e1b38b4291b36b9750f86e9266`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:07.514200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c41def39-6603-415d-9407-eb23a3c0208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:07.565213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a186d6c4-cce1-49cf-97e0-9e8e88111ca7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:07.705261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:07.706017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:07.706211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:07.706496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:07.712891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:07.735470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 885/1790] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:07.740071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902eb34-64ac-4992-8998-9ea68816bd30 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:07.741588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902eb34-64ac-4992-8998-9ea68816bd30 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:07.741880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3902eb34-64ac-4992-8998-9ea68816bd30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:07.796669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3902eb34-64ac-4992-8998-9ea68816bd30 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:07.797960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3902eb34-64ac-4992-8998-9ea68816bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:07.861438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:07.868398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:07.891494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 906/1791] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:07.893383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:07.899962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:07.936012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc5199-672d-4fc3-a3ee-01fa68d9f4b3 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:07.937570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 886/1792] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:07.943764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b22c343-d848-408a-bd23-2d9ff3fa6646 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:07.944603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c343-d848-408a-bd23-2d9ff3fa6646 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:07.945130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c343-d848-408a-bd23-2d9ff3fa6646 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:07.945513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b22c343-d848-408a-bd23-2d9ff3fa6646 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:07.958314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22c343-d848-408a-bd23-2d9ff3fa6646 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:07.960498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b22c343-d848-408a-bd23-2d9ff3fa6646 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:07.977094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 907/1793] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:08.353670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902eb34-64ac-4992-8998-9ea68816bd30 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:08.355225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3902eb34-64ac-4992-8998-9ea68816bd30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:08.525715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:08.544418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3902eb34-64ac-4992-8998-9ea68816bd30 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:08.549484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc5e55-b6e9-457d-9137-5d587b63ff52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:08.554273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5e55-b6e9-457d-9137-5d587b63ff52 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:08.554273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5e55-b6e9-457d-9137-5d587b63ff52 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:08.554273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc5e55-b6e9-457d-9137-5d587b63ff52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:08.563845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5e55-b6e9-457d-9137-5d587b63ff52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:08.566115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadc5e55-b6e9-457d-9137-5d587b63ff52 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:08.578993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 887/1794] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:09.663562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e7270-fecd-4be9-a116-72ccfd9d36a4 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:09.664577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e7270-fecd-4be9-a116-72ccfd9d36a4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:09.664997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299e7270-fecd-4be9-a116-72ccfd9d36a4 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:09.666897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 908/1795] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:49:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:49:10.165326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3522e-9d2c-4c10-9acd-838f558f37fd None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:10.165829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3522e-9d2c-4c10-9acd-838f558f37fd None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:10.165903 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d3522e-9d2c-4c10-9acd-838f558f37fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:10.243362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-19d3522e-9d2c-4c10-9acd-838f558f37fd None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:10.245019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-19d3522e-9d2c-4c10-9acd-838f558f37fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:10.500645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 888/1796] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:49:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:11.444698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e7270-fecd-4be9-a116-72ccfd9d36a4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:11.446579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-299e7270-fecd-4be9-a116-72ccfd9d36a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:11.496783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299e7270-fecd-4be9-a116-72ccfd9d36a4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:11.517769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d263e7-d9af-4e7f-b1f2-259f43982215 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:11.521713 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d263e7-d9af-4e7f-b1f2-259f43982215 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:11.529944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d263e7-d9af-4e7f-b1f2-259f43982215 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:11.530988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d263e7-d9af-4e7f-b1f2-259f43982215 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:11.604636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d263e7-d9af-4e7f-b1f2-259f43982215 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:11.610957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d263e7-d9af-4e7f-b1f2-259f43982215 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:11.644402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 909/1797] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:11.846941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2d9b-f93f-4208-bc14-bbb1c86ad209 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:11.851402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2d9b-f93f-4208-bc14-bbb1c86ad209 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:11.852068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1e2d9b-f93f-4208-bc14-bbb1c86ad209 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:11.854071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 889/1798] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:49:11 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:49:11.943946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87643c5-21f9-4f7c-ab2c-478d4b384d77 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:11.945074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87643c5-21f9-4f7c-ab2c-478d4b384d77 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:11.945503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87643c5-21f9-4f7c-ab2c-478d4b384d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:12.046326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e2d9b-f93f-4208-bc14-bbb1c86ad209 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:12.048188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b87643c5-21f9-4f7c-ab2c-478d4b384d77 None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:12.048974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0e1e2d9b-f93f-4208-bc14-bbb1c86ad209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:12.052079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b87643c5-21f9-4f7c-ab2c-478d4b384d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:12.111029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 910/1799] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:49:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:12.117379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1e2d9b-f93f-4208-bc14-bbb1c86ad209 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:12.134775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:12.138271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:12.141046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:12.141796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] PATH_INFO: `/v3/users/110af205a2e149a39d0c14247d4c21a9` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:12.148022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] RBAC: Authorizing `identity:delete_user(user_id=110af205a2e149a39d0c14247d4c21a9)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:12.157829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:12.218747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87643c5-21f9-4f7c-ab2c-478d4b384d77 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:12.247052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87643c5-21f9-4f7c-ab2c-478d4b384d77 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:12.268192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f6208f-07be-4c8d-8977-78612bc1c53c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:12.269175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6208f-07be-4c8d-8977-78612bc1c53c service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:12.269628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6208f-07be-4c8d-8977-78612bc1c53c service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:12.270075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f6208f-07be-4c8d-8977-78612bc1c53c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:12.315862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6208f-07be-4c8d-8977-78612bc1c53c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:12.320105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '110af205a2e149a39d0c14247d4c21a9'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:12.322263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f6208f-07be-4c8d-8977-78612bc1c53c service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:12.351000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '110af205a2e149a39d0c14247d4c21a9'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:12.352362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '110af205a2e149a39d0c14247d4c21a9'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:12.362451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 911/1800] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:12.394789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '110af205a2e149a39d0c14247d4c21a9'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:12.411474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '110af205a2e149a39d0c14247d4c21a9'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:12.446764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 890/1801] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:12 2022] DELETE /identity/v3/users/110af205a2e149a39d0c14247d4c21a9 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:12.448639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf56bf-7d39-43e2-8bf7-84025c3b87bc None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:12.449737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf56bf-7d39-43e2-8bf7-84025c3b87bc None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:12.450258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf56bf-7d39-43e2-8bf7-84025c3b87bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:12.477990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-5acf56bf-7d39-43e2-8bf7-84025c3b87bc None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:12.479593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5acf56bf-7d39-43e2-8bf7-84025c3b87bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:12.508558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:12.607406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 912/1802] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:12.684666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:12.686349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:12.771210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf56bf-7d39-43e2-8bf7-84025c3b87bc None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:12.772667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5acf56bf-7d39-43e2-8bf7-84025c3b87bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:12.809911 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf56bf-7d39-43e2-8bf7-84025c3b87bc None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:12.829735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:12.834118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:12.835465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:12.835794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] PATH_INFO: `/v3/projects/a86e6055977f430386c223cfaccee466` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:12.841157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a86e6055977f430386c223cfaccee466)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:12.846675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:12.887993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0543725c-63b3-42e3-8154-bb43af082dad admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:12.901475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c04a7c-ad15-4e4a-982f-1a5ce8e3fc3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:12.902520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c04a7c-ad15-4e4a-982f-1a5ce8e3fc3b service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:12.902967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c04a7c-ad15-4e4a-982f-1a5ce8e3fc3b service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:12.903527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c04a7c-ad15-4e4a-982f-1a5ce8e3fc3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:12.914602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:12.927881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c04a7c-ad15-4e4a-982f-1a5ce8e3fc3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:12.930896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c04a7c-ad15-4e4a-982f-1a5ce8e3fc3b service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:12.953619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 891/1803] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:12.990801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a86e6055977f430386c223cfaccee466', 'request_id': 'req-062124a0-a1a9-418c-94ac-3b11c8ed5053'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.004280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a86e6055977f430386c223cfaccee466', 'request_id': 'req-062124a0-a1a9-418c-94ac-3b11c8ed5053'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.021932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a86e6055977f430386c223cfaccee466', 'request_id': 'req-062124a0-a1a9-418c-94ac-3b11c8ed5053'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.040956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] The token cache is being invalidate because project a86e6055977f430386c223cfaccee466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:13.041541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.042492 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-062124a0-a1a9-418c-94ac-3b11c8ed5053 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.046091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 913/1804] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:12 2022] DELETE /identity/v3/projects/a86e6055977f430386c223cfaccee466 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:13.050780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c04a7c-ad15-4e4a-982f-1a5ce8e3fc3b service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:13.076306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c04a7c-ad15-4e4a-982f-1a5ce8e3fc3b service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:13.241511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:13.243579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:13.244864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:13.246241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] PATH_INFO: `/v3/users/749affd9f5624b65837e712f984ef452` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:13.250737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=749affd9f5624b65837e712f984ef452)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:13.257776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:13.388861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '749affd9f5624b65837e712f984ef452'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.410132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '749affd9f5624b65837e712f984ef452'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.410479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '749affd9f5624b65837e712f984ef452'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.457349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '749affd9f5624b65837e712f984ef452'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.491878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '749affd9f5624b65837e712f984ef452'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:13.522654 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 892/1805] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:13 2022] DELETE /identity/v3/users/749affd9f5624b65837e712f984ef452 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:14.454924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca7e61-342b-4e8f-a04c-0ca41401e3eb None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:14.455848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca7e61-342b-4e8f-a04c-0ca41401e3eb None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:14.458826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca7e61-342b-4e8f-a04c-0ca41401e3eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:14.528936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6dca7e61-342b-4e8f-a04c-0ca41401e3eb None None] MFA Rules not processed for user `e33cf9baa72248739f58cb3a3d7d078b`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:14.537468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6dca7e61-342b-4e8f-a04c-0ca41401e3eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:14.709444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 914/1806] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:15.399298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:15.401226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:15.560074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ba908-a684-4a4e-ae63-224c9d26be9e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:15.579640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:15.580867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:15.581160 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:15.582148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] PATH_INFO: `/v3/projects/74cbbd9a30c148449e47b9164b5b4771` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:15.583460 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74cbbd9a30c148449e47b9164b5b4771)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:15.585431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:15.603609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:15.650199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74cbbd9a30c148449e47b9164b5b4771', 'request_id': 'req-112aa1a7-d12a-4592-ae91-14d277560ca7'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.666379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74cbbd9a30c148449e47b9164b5b4771', 'request_id': 'req-112aa1a7-d12a-4592-ae91-14d277560ca7'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.676146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74cbbd9a30c148449e47b9164b5b4771', 'request_id': 'req-112aa1a7-d12a-4592-ae91-14d277560ca7'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.695284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] The token cache is being invalidate because project 74cbbd9a30c148449e47b9164b5b4771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:15.695643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.696253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.701923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 893/1807] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:15 2022] DELETE /identity/v3/projects/74cbbd9a30c148449e47b9164b5b4771 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:15.703891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca7e61-342b-4e8f-a04c-0ca41401e3eb None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:15.716788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca7e61-342b-4e8f-a04c-0ca41401e3eb None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:15.733359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:15.736162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:15.777471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:15.790580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:15.791907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:15.792693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:15.793938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] PATH_INFO: `/v3/users/9c8ca9e1b38b4291b36b9750f86e9266` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:15.795199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c8ca9e1b38b4291b36b9750f86e9266)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:15.798089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:15.844540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112aa1a7-d12a-4592-ae91-14d277560ca7 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:15.849994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:15.851190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:15.851601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:15.852007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] PATH_INFO: `/v3/projects/8ece5305b81f40cabc475a83fdd97209` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:15.853380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ece5305b81f40cabc475a83fdd97209)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:15.855471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:15.856101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c8ca9e1b38b4291b36b9750f86e9266'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.864989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c8ca9e1b38b4291b36b9750f86e9266'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.866108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c8ca9e1b38b4291b36b9750f86e9266'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.874391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c8ca9e1b38b4291b36b9750f86e9266'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.890190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-580ed2b4-b811-451c-85f1-d8704bcc4b18 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c8ca9e1b38b4291b36b9750f86e9266'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.897625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 915/1808] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:15 2022] DELETE /identity/v3/users/9c8ca9e1b38b4291b36b9750f86e9266 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:15.913508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ece5305b81f40cabc475a83fdd97209', 'request_id': 'req-fb2f9153-a410-4808-9420-4e5d0c7d4746'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.923128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ece5305b81f40cabc475a83fdd97209', 'request_id': 'req-fb2f9153-a410-4808-9420-4e5d0c7d4746'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.932224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ece5305b81f40cabc475a83fdd97209', 'request_id': 'req-fb2f9153-a410-4808-9420-4e5d0c7d4746'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.948123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] The token cache is being invalidate because project 8ece5305b81f40cabc475a83fdd97209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:15.948748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.949767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fb2f9153-a410-4808-9420-4e5d0c7d4746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:15.951506 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 894/1809] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:15 2022] DELETE /identity/v3/projects/8ece5305b81f40cabc475a83fdd97209 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:15.957971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ac6bf-d0b5-4e90-b407-a8d2114e2317 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:15.958269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ac6bf-d0b5-4e90-b407-a8d2114e2317 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:15.958555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ac6bf-d0b5-4e90-b407-a8d2114e2317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:15.983888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-306ac6bf-d0b5-4e90-b407-a8d2114e2317 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:15.985144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-306ac6bf-d0b5-4e90-b407-a8d2114e2317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:16.112055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 916/1810] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:16.123387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578dc01-3a1b-455a-91e2-144593f457d5 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.125809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578dc01-3a1b-455a-91e2-144593f457d5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.126404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578dc01-3a1b-455a-91e2-144593f457d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.178614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-5578dc01-3a1b-455a-91e2-144593f457d5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:16.180006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5578dc01-3a1b-455a-91e2-144593f457d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:16.194358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 895/1811] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:16.194949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ac6bf-d0b5-4e90-b407-a8d2114e2317 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.212298 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ac6bf-d0b5-4e90-b407-a8d2114e2317 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.223596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233d720-0129-4382-b848-6e0879afbe48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.224321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233d720-0129-4382-b848-6e0879afbe48 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.224608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233d720-0129-4382-b848-6e0879afbe48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.224886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d233d720-0129-4382-b848-6e0879afbe48 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.225645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233d720-0129-4382-b848-6e0879afbe48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:16.225972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233d720-0129-4382-b848-6e0879afbe48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.227634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d233d720-0129-4382-b848-6e0879afbe48 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.245790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 917/1812] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:49:16.250429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578dc01-3a1b-455a-91e2-144593f457d5 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.252886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5578dc01-3a1b-455a-91e2-144593f457d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:16.270086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233d720-0129-4382-b848-6e0879afbe48 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.295441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578dc01-3a1b-455a-91e2-144593f457d5 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.319944 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.320835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.321327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.321851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] PATH_INFO: `/v3/projects/70ffd530063e429dbe4ed37742f1931d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.323242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70ffd530063e429dbe4ed37742f1931d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.325371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.328844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d233d720-0129-4382-b848-6e0879afbe48 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.335332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474f9a1-7a2c-40c5-be66-b7620836edd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.335950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474f9a1-7a2c-40c5-be66-b7620836edd5 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.336232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474f9a1-7a2c-40c5-be66-b7620836edd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.336511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b474f9a1-7a2c-40c5-be66-b7620836edd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.338493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474f9a1-7a2c-40c5-be66-b7620836edd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.340843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b474f9a1-7a2c-40c5-be66-b7620836edd5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.356492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:16.387023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 918/1813] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:16 2022] POST /identity/v3/projects => generated 385 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:16.390448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474f9a1-7a2c-40c5-be66-b7620836edd5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.392274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70ffd530063e429dbe4ed37742f1931d', 'request_id': 'req-72540d93-6998-4e3a-9364-5f9c6f6a1921'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:16.402829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70ffd530063e429dbe4ed37742f1931d', 'request_id': 'req-72540d93-6998-4e3a-9364-5f9c6f6a1921'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:16.409357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70ffd530063e429dbe4ed37742f1931d', 'request_id': 'req-72540d93-6998-4e3a-9364-5f9c6f6a1921'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:16.442015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] The token cache is being invalidate because project 70ffd530063e429dbe4ed37742f1931d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:16.442127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:16.442901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-72540d93-6998-4e3a-9364-5f9c6f6a1921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:16.448211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 896/1814] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:16 2022] DELETE /identity/v3/projects/70ffd530063e429dbe4ed37742f1931d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:16.449606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:16.449751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d190-734d-4df9-a86b-754545bab548 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.449936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d190-734d-4df9-a86b-754545bab548 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.450265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46d190-734d-4df9-a86b-754545bab548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.484855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b474f9a1-7a2c-40c5-be66-b7620836edd5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.487829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-fd46d190-734d-4df9-a86b-754545bab548 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:16.489781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-fd46d190-734d-4df9-a86b-754545bab548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:16.489934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90cec9-862e-49ba-b4d2-37d9ec67768a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.490535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90cec9-862e-49ba-b4d2-37d9ec67768a admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.490840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90cec9-862e-49ba-b4d2-37d9ec67768a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.491114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90cec9-862e-49ba-b4d2-37d9ec67768a admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.491755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90cec9-862e-49ba-b4d2-37d9ec67768a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.493719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e90cec9-862e-49ba-b4d2-37d9ec67768a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.512606 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 897/1815] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:16.522882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675db2f-10da-4765-a7dc-c84e3b62840d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.523233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675db2f-10da-4765-a7dc-c84e3b62840d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.523571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0675db2f-10da-4765-a7dc-c84e3b62840d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.530113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 919/1816] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:16 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:16.535113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90cec9-862e-49ba-b4d2-37d9ec67768a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.543397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9e90cec9-862e-49ba-b4d2-37d9ec67768a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:16.556089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0675db2f-10da-4765-a7dc-c84e3b62840d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:16.558359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0675db2f-10da-4765-a7dc-c84e3b62840d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:16.558626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90cec9-862e-49ba-b4d2-37d9ec67768a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.564561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5c6c7-8638-4688-92db-0efb236b1f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.565473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5c6c7-8638-4688-92db-0efb236b1f3f admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.565966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5c6c7-8638-4688-92db-0efb236b1f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.566418 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc5c6c7-8638-4688-92db-0efb236b1f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.567214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5c6c7-8638-4688-92db-0efb236b1f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.569282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc5c6c7-8638-4688-92db-0efb236b1f3f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.574530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 898/1817] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:16.575667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675db2f-10da-4765-a7dc-c84e3b62840d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.588548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0675db2f-10da-4765-a7dc-c84e3b62840d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.598671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 920/1818] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:16.600032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5c6c7-8638-4688-92db-0efb236b1f3f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.600474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03bd0d-6ea3-4f04-8c10-24f684102a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.601385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03bd0d-6ea3-4f04-8c10-24f684102a15 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.601901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03bd0d-6ea3-4f04-8c10-24f684102a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.602277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a03bd0d-6ea3-4f04-8c10-24f684102a15 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.603184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03bd0d-6ea3-4f04-8c10-24f684102a15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:16.603585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03bd0d-6ea3-4f04-8c10-24f684102a15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.607855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a03bd0d-6ea3-4f04-8c10-24f684102a15 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.613605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc5c6c7-8638-4688-92db-0efb236b1f3f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.619585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b992-5f37-4dd3-92f9-bbdbb2527a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.620448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b992-5f37-4dd3-92f9-bbdbb2527a47 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.621516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b992-5f37-4dd3-92f9-bbdbb2527a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.622063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60b992-5f37-4dd3-92f9-bbdbb2527a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.622933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60b992-5f37-4dd3-92f9-bbdbb2527a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.625759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b60b992-5f37-4dd3-92f9-bbdbb2527a47 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.636992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 899/1819] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:16.638055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03bd0d-6ea3-4f04-8c10-24f684102a15 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.653851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 921/1820] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:16.657655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a03bd0d-6ea3-4f04-8c10-24f684102a15 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.660939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b992-5f37-4dd3-92f9-bbdbb2527a47 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.664795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4b61d-b064-42fa-a2b7-3eb55ca9a28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.667093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4b61d-b064-42fa-a2b7-3eb55ca9a28c admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.667406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4b61d-b064-42fa-a2b7-3eb55ca9a28c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.668515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d4b61d-b064-42fa-a2b7-3eb55ca9a28c admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.669188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4b61d-b064-42fa-a2b7-3eb55ca9a28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.671299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d4b61d-b064-42fa-a2b7-3eb55ca9a28c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.677344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60b992-5f37-4dd3-92f9-bbdbb2527a47 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.683307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dc58a0-00c9-41cb-b160-35377c3dfd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.684242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc58a0-00c9-41cb-b160-35377c3dfd56 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.685048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc58a0-00c9-41cb-b160-35377c3dfd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.685565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dc58a0-00c9-41cb-b160-35377c3dfd56 admin admin] PATH_INFO: `/v3/projects/0bc63a8c60354fd8a8f684ff6b6f2914/users/ae7c0d6864254dc7a6a4cd13a04be8e0/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.709991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc58a0-00c9-41cb-b160-35377c3dfd56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bc63a8c60354fd8a8f684ff6b6f2914, user_id=ae7c0d6864254dc7a6a4cd13a04be8e0, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.715604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 900/1821] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:16 2022] POST /identity/v3/projects => generated 379 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:16.716961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4b61d-b064-42fa-a2b7-3eb55ca9a28c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.719362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dc58a0-00c9-41cb-b160-35377c3dfd56 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.743147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 922/1822] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:16 2022] PUT /identity/v3/projects/0bc63a8c60354fd8a8f684ff6b6f2914/users/ae7c0d6864254dc7a6a4cd13a04be8e0/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:16.756478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa534d2-77da-44a9-82f6-cfe657e1b803 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.757027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa534d2-77da-44a9-82f6-cfe657e1b803 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.757348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa534d2-77da-44a9-82f6-cfe657e1b803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.791004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6fa534d2-77da-44a9-82f6-cfe657e1b803 None None] MFA Rules not processed for user `ae7c0d6864254dc7a6a4cd13a04be8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:16.792751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6fa534d2-77da-44a9-82f6-cfe657e1b803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:16.809107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d4b61d-b064-42fa-a2b7-3eb55ca9a28c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.898955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 923/1823] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:16.900838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae69bc-d38d-4dc1-8609-e5bcfa862f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.901508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae69bc-d38d-4dc1-8609-e5bcfa862f4c admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.901792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae69bc-d38d-4dc1-8609-e5bcfa862f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:16.902069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae69bc-d38d-4dc1-8609-e5bcfa862f4c admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:16.905928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae69bc-d38d-4dc1-8609-e5bcfa862f4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:16.910880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa534d2-77da-44a9-82f6-cfe657e1b803 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.912347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6fa534d2-77da-44a9-82f6-cfe657e1b803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:16.914987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aae69bc-d38d-4dc1-8609-e5bcfa862f4c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:16.943778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=7,keystone:SELECT=88,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:16.958929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 901/1824] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:16 2022] POST /identity/v3/users => generated 290 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:16.965340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae69bc-d38d-4dc1-8609-e5bcfa862f4c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:16.988703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aae69bc-d38d-4dc1-8609-e5bcfa862f4c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:16.998805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77465e-d1f8-40ce-bca5-3a79eb5e6802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:16.999627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77465e-d1f8-40ce-bca5-3a79eb5e6802 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:16.999905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77465e-d1f8-40ce-bca5-3a79eb5e6802 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.000197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae77465e-d1f8-40ce-bca5-3a79eb5e6802 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.001536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77465e-d1f8-40ce-bca5-3a79eb5e6802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.004488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae77465e-d1f8-40ce-bca5-3a79eb5e6802 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:17.008769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa534d2-77da-44a9-82f6-cfe657e1b803 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:17.016552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90f1fd-13b0-4321-92ac-34e5e12ad335 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:17.017754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90f1fd-13b0-4321-92ac-34e5e12ad335 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.018130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90f1fd-13b0-4321-92ac-34e5e12ad335 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.018576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f90f1fd-13b0-4321-92ac-34e5e12ad335 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.035823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90f1fd-13b0-4321-92ac-34e5e12ad335 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.037940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 902/1825] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:16 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:17.040496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f90f1fd-13b0-4321-92ac-34e5e12ad335 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:17.048521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77465e-d1f8-40ce-bca5-3a79eb5e6802 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:17.055565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 924/1826] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:49:17.067065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae77465e-d1f8-40ce-bca5-3a79eb5e6802 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:17.072212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784615d6-befd-4b32-9a3e-21a9d760a061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:17.072842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784615d6-befd-4b32-9a3e-21a9d760a061 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.073131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784615d6-befd-4b32-9a3e-21a9d760a061 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.073695 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784615d6-befd-4b32-9a3e-21a9d760a061 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.074703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784615d6-befd-4b32-9a3e-21a9d760a061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.076466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784615d6-befd-4b32-9a3e-21a9d760a061 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:17.106157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 903/1827] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:17.110141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90f1fd-13b0-4321-92ac-34e5e12ad335 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:17.152636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f90f1fd-13b0-4321-92ac-34e5e12ad335 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:17.162082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af4f54-84ff-4fa5-bab4-7b0148c30c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:17.162777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af4f54-84ff-4fa5-bab4-7b0148c30c15 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.163041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af4f54-84ff-4fa5-bab4-7b0148c30c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.163316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af4f54-84ff-4fa5-bab4-7b0148c30c15 admin admin] PATH_INFO: `/v3/projects/32ba1c0cd65d4319b1106404d28d38c2/users/b8e7598cd8cf4c3d89a07f00b1c2bbd9/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.186653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:17.193932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af4f54-84ff-4fa5-bab4-7b0148c30c15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ba1c0cd65d4319b1106404d28d38c2, user_id=b8e7598cd8cf4c3d89a07f00b1c2bbd9, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.197621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af4f54-84ff-4fa5-bab4-7b0148c30c15 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:17.218615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 925/1828] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:17 2022] PUT /identity/v3/projects/32ba1c0cd65d4319b1106404d28d38c2/users/b8e7598cd8cf4c3d89a07f00b1c2bbd9/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:17.229053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e8a2-d852-4073-b8df-4815dbb46423 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.229607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e8a2-d852-4073-b8df-4815dbb46423 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.229750 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d6e8a2-d852-4073-b8df-4815dbb46423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.284228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-c4d6e8a2-d852-4073-b8df-4815dbb46423 None None] MFA Rules not processed for user `b8e7598cd8cf4c3d89a07f00b1c2bbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:17.287535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c4d6e8a2-d852-4073-b8df-4815dbb46423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:17.455394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 904/1829] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:17.460652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af4f54-84ff-4fa5-bab4-7b0148c30c15 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:17.593921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af4f54-84ff-4fa5-bab4-7b0148c30c15 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:17.600393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d17bc-c644-42de-b54c-7741745f0dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:17.601122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d17bc-c644-42de-b54c-7741745f0dcb admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.601423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d17bc-c644-42de-b54c-7741745f0dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.601701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1d17bc-c644-42de-b54c-7741745f0dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.602342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d17bc-c644-42de-b54c-7741745f0dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.604269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1d17bc-c644-42de-b54c-7741745f0dcb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:17.638722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 926/1830] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:17 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:17.642775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6e8a2-d852-4073-b8df-4815dbb46423 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:17.653948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d6e8a2-d852-4073-b8df-4815dbb46423 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:17.710664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09cae-0f43-40c4-a0f4-1f33ee125c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:17.711194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09cae-0f43-40c4-a0f4-1f33ee125c52 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.711473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09cae-0f43-40c4-a0f4-1f33ee125c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.711989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09cae-0f43-40c4-a0f4-1f33ee125c52 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.712620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09cae-0f43-40c4-a0f4-1f33ee125c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.714577 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09cae-0f43-40c4-a0f4-1f33ee125c52 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:17.739998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 905/1831] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:17 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:17.741174 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d17bc-c644-42de-b54c-7741745f0dcb admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:17.752075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1d17bc-c644-42de-b54c-7741745f0dcb admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:17.756790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9220d-5ec7-4622-8112-9cc664e92a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:17.757470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9220d-5ec7-4622-8112-9cc664e92a3d admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.757753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9220d-5ec7-4622-8112-9cc664e92a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.758027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9220d-5ec7-4622-8112-9cc664e92a3d admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.758671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9220d-5ec7-4622-8112-9cc664e92a3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.760230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f9220d-5ec7-4622-8112-9cc664e92a3d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:17.772160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 927/1832] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:17.776169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09cae-0f43-40c4-a0f4-1f33ee125c52 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:17.787553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09cae-0f43-40c4-a0f4-1f33ee125c52 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:17.793204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e5b2-0d7b-4fdc-9afd-be5e797c0de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:17.794104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e5b2-0d7b-4fdc-9afd-be5e797c0de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.794414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e5b2-0d7b-4fdc-9afd-be5e797c0de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.795093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21e5b2-0d7b-4fdc-9afd-be5e797c0de9 admin admin] PATH_INFO: `/v3/projects/f35a3ffe845c4c02a045fb9d6ac12169/users/38c1ed7e2a2d47dc986a60bdf3bbe18b/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.812381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e5b2-0d7b-4fdc-9afd-be5e797c0de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35a3ffe845c4c02a045fb9d6ac12169, user_id=38c1ed7e2a2d47dc986a60bdf3bbe18b, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.815244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21e5b2-0d7b-4fdc-9afd-be5e797c0de9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:17.834291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 906/1833] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:17 2022] PUT /identity/v3/projects/f35a3ffe845c4c02a045fb9d6ac12169/users/38c1ed7e2a2d47dc986a60bdf3bbe18b/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:17.838661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9220d-5ec7-4622-8112-9cc664e92a3d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:17.852925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9220d-5ec7-4622-8112-9cc664e92a3d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:17.922699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2ccd7-be2c-4133-9eab-d9af90227bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:17.923319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ccd7-be2c-4133-9eab-d9af90227bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.923605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ccd7-be2c-4133-9eab-d9af90227bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.923881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ccd7-be2c-4133-9eab-d9af90227bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.924529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2ccd7-be2c-4133-9eab-d9af90227bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.926371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2ccd7-be2c-4133-9eab-d9af90227bb9 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:17.937011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 928/1834] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:17 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:17.942309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e5b2-0d7b-4fdc-9afd-be5e797c0de9 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:17.954459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21e5b2-0d7b-4fdc-9afd-be5e797c0de9 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:17.960803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa96a3-6223-43b3-a46e-6738c2d1199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:17.961423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa96a3-6223-43b3-a46e-6738c2d1199c admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:17.961714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa96a3-6223-43b3-a46e-6738c2d1199c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:17.962243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa96a3-6223-43b3-a46e-6738c2d1199c admin admin] PATH_INFO: `/v3/projects/f35a3ffe845c4c02a045fb9d6ac12169/users/38c1ed7e2a2d47dc986a60bdf3bbe18b/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:17.964499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa96a3-6223-43b3-a46e-6738c2d1199c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35a3ffe845c4c02a045fb9d6ac12169, user_id=38c1ed7e2a2d47dc986a60bdf3bbe18b, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:17.970623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa96a3-6223-43b3-a46e-6738c2d1199c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:18.021777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 907/1835] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:17 2022] PUT /identity/v3/projects/f35a3ffe845c4c02a045fb9d6ac12169/users/38c1ed7e2a2d47dc986a60bdf3bbe18b/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:18.034208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678a0d-1739-46ea-ad64-d37980687b68 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:18.035241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678a0d-1739-46ea-ad64-d37980687b68 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:18.035535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44678a0d-1739-46ea-ad64-d37980687b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:18.092856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-44678a0d-1739-46ea-ad64-d37980687b68 None None] MFA Rules not processed for user `38c1ed7e2a2d47dc986a60bdf3bbe18b`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:18.097719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-44678a0d-1739-46ea-ad64-d37980687b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:18.179239 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:18.205549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 929/1836] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:18.218387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa96a3-6223-43b3-a46e-6738c2d1199c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:18.242666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:18.289783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa96a3-6223-43b3-a46e-6738c2d1199c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:18.293820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1029ad-c300-4031-87ff-72af4985b964 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:18.294444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1029ad-c300-4031-87ff-72af4985b964 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:18.294726 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1029ad-c300-4031-87ff-72af4985b964 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:18.295003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1029ad-c300-4031-87ff-72af4985b964 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:18.308393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1029ad-c300-4031-87ff-72af4985b964 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:18.310632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1029ad-c300-4031-87ff-72af4985b964 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:18.323843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 908/1837] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:18 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:18.815940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678a0d-1739-46ea-ad64-d37980687b68 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:18.835498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44678a0d-1739-46ea-ad64-d37980687b68 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:18.847987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816bc90-8370-403f-bb98-10a0a6e35d0b tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c1ed7e2a2d47dc986a60bdf3bbe18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f35a3ffe845c4c02a045fb9d6ac12169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:18.848779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bc90-8370-403f-bb98-10a0a6e35d0b tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:18.849184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bc90-8370-403f-bb98-10a0a6e35d0b tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:18.849582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816bc90-8370-403f-bb98-10a0a6e35d0b tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:18.850347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816bc90-8370-403f-bb98-10a0a6e35d0b tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:18.850715 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816bc90-8370-403f-bb98-10a0a6e35d0b tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:18.852404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816bc90-8370-403f-bb98-10a0a6e35d0b tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:18.876989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 930/1838] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:18.886461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1029ad-c300-4031-87ff-72af4985b964 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:18.891890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1029ad-c300-4031-87ff-72af4985b964 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:18.908638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70384d62-43a6-4a94-9f36-a3764d8e8bdc tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c1ed7e2a2d47dc986a60bdf3bbe18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f35a3ffe845c4c02a045fb9d6ac12169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:18.909951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70384d62-43a6-4a94-9f36-a3764d8e8bdc tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:18.910282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70384d62-43a6-4a94-9f36-a3764d8e8bdc tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:18.910568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70384d62-43a6-4a94-9f36-a3764d8e8bdc tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:18.911220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70384d62-43a6-4a94-9f36-a3764d8e8bdc tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:18.913318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70384d62-43a6-4a94-9f36-a3764d8e8bdc tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:18.981887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 909/1839] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:18 2022] POST /identity/v3/projects => generated 353 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:18.987053 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816bc90-8370-403f-bb98-10a0a6e35d0b tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:19.006988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816bc90-8370-403f-bb98-10a0a6e35d0b tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:19.115647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c1ed7e2a2d47dc986a60bdf3bbe18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f35a3ffe845c4c02a045fb9d6ac12169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:19.116275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:19.117265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:19.117587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:19.118415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:19.119487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:19.121116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:19.140320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 931/1840] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:19.189897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70384d62-43a6-4a94-9f36-a3764d8e8bdc tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:19.217897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70384d62-43a6-4a94-9f36-a3764d8e8bdc tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:19.229462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38c1ed7e2a2d47dc986a60bdf3bbe18b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f35a3ffe845c4c02a045fb9d6ac12169', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:19.230233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:19.230440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:19.231021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] PATH_INFO: `/v3/projects/6066e19494e14fccbe8a909b2c691813` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:19.231804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6066e19494e14fccbe8a909b2c691813)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:19.238362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:19.344546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6066e19494e14fccbe8a909b2c691813', 'request_id': 'req-228e5b1c-e76f-4697-a73d-9311e8ff2777'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:19.359017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6066e19494e14fccbe8a909b2c691813', 'request_id': 'req-228e5b1c-e76f-4697-a73d-9311e8ff2777'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:19.369896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6066e19494e14fccbe8a909b2c691813', 'request_id': 'req-228e5b1c-e76f-4697-a73d-9311e8ff2777'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:19.387571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] The token cache is being invalidate because project 6066e19494e14fccbe8a909b2c691813 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:19.387872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:19.389014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-228e5b1c-e76f-4697-a73d-9311e8ff2777 tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:19.390894 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 910/1841] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:19 2022] DELETE /identity/v3/projects/6066e19494e14fccbe8a909b2c691813 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:19.660351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:19.662074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:19.788419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf79dbb-348d-4779-b10e-e514f419fc1a tempest-VolumeQuotaClassesTest-1294787536 tempest-VolumeQuotaClassesTest-1294787536-project-admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:19.928147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:19.928828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:19.929071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:19.929343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] PATH_INFO: `/v3/users/b8e7598cd8cf4c3d89a07f00b1c2bbd9` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:19.930539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8e7598cd8cf4c3d89a07f00b1c2bbd9)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:19.932452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:19.947295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:20.016817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8e7598cd8cf4c3d89a07f00b1c2bbd9'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:20.029652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8e7598cd8cf4c3d89a07f00b1c2bbd9'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:20.030813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8e7598cd8cf4c3d89a07f00b1c2bbd9'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:20.042230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8e7598cd8cf4c3d89a07f00b1c2bbd9'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:20.071145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8e7598cd8cf4c3d89a07f00b1c2bbd9'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:20.082262 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 932/1842] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:19 2022] DELETE /identity/v3/users/b8e7598cd8cf4c3d89a07f00b1c2bbd9 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:20.088055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e26a6-dafe-446a-9bc8-38640f78f593 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:20.088553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e26a6-dafe-446a-9bc8-38640f78f593 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:20.088824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e26a6-dafe-446a-9bc8-38640f78f593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:20.125256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-758e26a6-dafe-446a-9bc8-38640f78f593 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:20.126353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-758e26a6-dafe-446a-9bc8-38640f78f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:20.266265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 911/1843] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:20.406949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:20.408392 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:20.584982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc671d2b-99b9-4232-a946-5a6b48d2a598 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:20.603032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2311445-2780-449e-8ff4-aec1dc4c2f73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:20.603860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2311445-2780-449e-8ff4-aec1dc4c2f73 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:20.604289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2311445-2780-449e-8ff4-aec1dc4c2f73 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:20.604727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2311445-2780-449e-8ff4-aec1dc4c2f73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:20.647469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2311445-2780-449e-8ff4-aec1dc4c2f73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:20.655593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2311445-2780-449e-8ff4-aec1dc4c2f73 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:20.686983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 933/1844] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:22.255790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e26a6-dafe-446a-9bc8-38640f78f593 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:22.257790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-758e26a6-dafe-446a-9bc8-38640f78f593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:22.281088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e26a6-dafe-446a-9bc8-38640f78f593 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:22.296107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:22.296962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:22.297389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:22.297910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] PATH_INFO: `/v3/projects/32ba1c0cd65d4319b1106404d28d38c2` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:22.299550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ba1c0cd65d4319b1106404d28d38c2)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:22.302655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:22.354343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:22.432066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ba1c0cd65d4319b1106404d28d38c2', 'request_id': 'req-5e87e655-6c9f-4431-a3b6-29e9488d470b'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.443777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ba1c0cd65d4319b1106404d28d38c2', 'request_id': 'req-5e87e655-6c9f-4431-a3b6-29e9488d470b'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.454785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ba1c0cd65d4319b1106404d28d38c2', 'request_id': 'req-5e87e655-6c9f-4431-a3b6-29e9488d470b'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.510052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] The token cache is being invalidate because project 32ba1c0cd65d4319b1106404d28d38c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:22.510468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.516844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.518849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 912/1845] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:22 2022] DELETE /identity/v3/projects/32ba1c0cd65d4319b1106404d28d38c2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:22.524783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2311445-2780-449e-8ff4-aec1dc4c2f73 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:22.542288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2311445-2780-449e-8ff4-aec1dc4c2f73 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:22.720015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:22.720668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:22.722671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:22.722975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] PATH_INFO: `/v3/users/38c1ed7e2a2d47dc986a60bdf3bbe18b` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:22.724371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=38c1ed7e2a2d47dc986a60bdf3bbe18b)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:22.727054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:22.791725 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:22.802586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38c1ed7e2a2d47dc986a60bdf3bbe18b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.811293 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38c1ed7e2a2d47dc986a60bdf3bbe18b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.812060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38c1ed7e2a2d47dc986a60bdf3bbe18b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.819807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38c1ed7e2a2d47dc986a60bdf3bbe18b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.837788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2897bcfa-8e22-4d1d-b730-ae2ba43641ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38c1ed7e2a2d47dc986a60bdf3bbe18b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:22.844575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 934/1846] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:22 2022] DELETE /identity/v3/users/38c1ed7e2a2d47dc986a60bdf3bbe18b => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:23.118696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:23.123220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:23.146144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87e655-6c9f-4431-a3b6-29e9488d470b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:23.213599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:23.214243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.214521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.214799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] PATH_INFO: `/v3/projects/f35a3ffe845c4c02a045fb9d6ac12169` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.215956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35a3ffe845c4c02a045fb9d6ac12169)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:23.217922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:23.265454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35a3ffe845c4c02a045fb9d6ac12169', 'request_id': 'req-8b433f14-a099-482d-9dd3-86d6a99572eb'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.273540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35a3ffe845c4c02a045fb9d6ac12169', 'request_id': 'req-8b433f14-a099-482d-9dd3-86d6a99572eb'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.279229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35a3ffe845c4c02a045fb9d6ac12169', 'request_id': 'req-8b433f14-a099-482d-9dd3-86d6a99572eb'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.290626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] The token cache is being invalidate because project f35a3ffe845c4c02a045fb9d6ac12169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:23.290914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.291558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-8b433f14-a099-482d-9dd3-86d6a99572eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.293049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 913/1847] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:23 2022] DELETE /identity/v3/projects/f35a3ffe845c4c02a045fb9d6ac12169 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:23.299284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c17bf0-65ec-440e-ada1-15421af1ed76 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.299567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c17bf0-65ec-440e-ada1-15421af1ed76 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.300383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c17bf0-65ec-440e-ada1-15421af1ed76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.320253 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b1c17bf0-65ec-440e-ada1-15421af1ed76 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:23.321471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b1c17bf0-65ec-440e-ada1-15421af1ed76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:23.405093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 935/1848] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:23.413444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398823b-65d5-4c6e-88ad-11f04dace034 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.414337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398823b-65d5-4c6e-88ad-11f04dace034 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.414626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398823b-65d5-4c6e-88ad-11f04dace034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.439573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0398823b-65d5-4c6e-88ad-11f04dace034 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:23.440904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0398823b-65d5-4c6e-88ad-11f04dace034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:23.449105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 914/1849] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:23.453379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c17bf0-65ec-440e-ada1-15421af1ed76 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:23.463767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c17bf0-65ec-440e-ada1-15421af1ed76 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:23.468864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:23.469515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.469797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.470073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.470733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:23.471036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:23.473189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:23.487085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 936/1850] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:23.492276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398823b-65d5-4c6e-88ad-11f04dace034 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:23.505640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0398823b-65d5-4c6e-88ad-11f04dace034 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:23.513211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe260c-f9d9-4ca9-99fd-ac5d94196093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:23.513875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe260c-f9d9-4ca9-99fd-ac5d94196093 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.514202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe260c-f9d9-4ca9-99fd-ac5d94196093 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.514641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe260c-f9d9-4ca9-99fd-ac5d94196093 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.515288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe260c-f9d9-4ca9-99fd-ac5d94196093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:23.517387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe260c-f9d9-4ca9-99fd-ac5d94196093 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:23.529014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:23.537696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:23.555698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 915/1851] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:23 2022] POST /identity/v3/projects => generated 401 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:23.559527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe260c-f9d9-4ca9-99fd-ac5d94196093 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:23.567447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8bc0b-0fed-4e13-b331-ab3abb890c55 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:23.571948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:23.645854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:23.647285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.647739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.648302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] PATH_INFO: `/v3/users/ae7c0d6864254dc7a6a4cd13a04be8e0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.649594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae7c0d6864254dc7a6a4cd13a04be8e0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:23.651175 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe260c-f9d9-4ca9-99fd-ac5d94196093 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:23.659078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:23.665835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba9d0c-c40c-46d6-a411-3ee0ff623e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:23.666464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba9d0c-c40c-46d6-a411-3ee0ff623e93 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.666859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba9d0c-c40c-46d6-a411-3ee0ff623e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.667000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba9d0c-c40c-46d6-a411-3ee0ff623e93 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.667715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba9d0c-c40c-46d6-a411-3ee0ff623e93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:23.669783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba9d0c-c40c-46d6-a411-3ee0ff623e93 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:23.696879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 916/1852] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:23 2022] POST /identity/v3/users => generated 301 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:23.701218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba9d0c-c40c-46d6-a411-3ee0ff623e93 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:23.713237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba9d0c-c40c-46d6-a411-3ee0ff623e93 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:23.719844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400c44-e434-4ad2-b510-b57adb381b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:23.720651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400c44-e434-4ad2-b510-b57adb381b3f admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.720947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400c44-e434-4ad2-b510-b57adb381b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.721221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d400c44-e434-4ad2-b510-b57adb381b3f admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.722433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d400c44-e434-4ad2-b510-b57adb381b3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:23.723594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:23.724254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d400c44-e434-4ad2-b510-b57adb381b3f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:23.726276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae7c0d6864254dc7a6a4cd13a04be8e0'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.738974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 917/1853] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:23.739959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae7c0d6864254dc7a6a4cd13a04be8e0'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.740831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae7c0d6864254dc7a6a4cd13a04be8e0'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.743162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400c44-e434-4ad2-b510-b57adb381b3f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:23.746719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8d400c44-e434-4ad2-b510-b57adb381b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:23.750052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae7c0d6864254dc7a6a4cd13a04be8e0'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.763662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d400c44-e434-4ad2-b510-b57adb381b3f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:23.764078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-560af5d9-f79a-4814-a6d8-9b1e1243985c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae7c0d6864254dc7a6a4cd13a04be8e0'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:23.770478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af958a76-d40a-4db9-a321-700835df3d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:23.771292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 937/1854] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:23 2022] DELETE /identity/v3/users/ae7c0d6864254dc7a6a4cd13a04be8e0 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:23.773610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af958a76-d40a-4db9-a321-700835df3d74 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.774027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af958a76-d40a-4db9-a321-700835df3d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.774391 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af958a76-d40a-4db9-a321-700835df3d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.775144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af958a76-d40a-4db9-a321-700835df3d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:23.775953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05929946-4b67-4b16-a01e-0a4609f91fd1 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.776239 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05929946-4b67-4b16-a01e-0a4609f91fd1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.776512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05929946-4b67-4b16-a01e-0a4609f91fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.777052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af958a76-d40a-4db9-a321-700835df3d74 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:23.789464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 918/1855] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:23.794383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af958a76-d40a-4db9-a321-700835df3d74 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:23.805818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af958a76-d40a-4db9-a321-700835df3d74 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:23.807816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-05929946-4b67-4b16-a01e-0a4609f91fd1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:23.809238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-05929946-4b67-4b16-a01e-0a4609f91fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:23.876510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6476999f-0593-426e-a4cf-6d45faa1ee58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:23.877288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476999f-0593-426e-a4cf-6d45faa1ee58 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.877959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476999f-0593-426e-a4cf-6d45faa1ee58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.878125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6476999f-0593-426e-a4cf-6d45faa1ee58 admin admin] PATH_INFO: `/v3/projects/d2503af5dc044e00b5ea1884221f15d0/users/0a206e67e46a4d259e3096f259c8f588/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:23.905891 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476999f-0593-426e-a4cf-6d45faa1ee58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2503af5dc044e00b5ea1884221f15d0, user_id=0a206e67e46a4d259e3096f259c8f588, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:23.908801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6476999f-0593-426e-a4cf-6d45faa1ee58 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:23.928235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 938/1856] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:23.929238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05929946-4b67-4b16-a01e-0a4609f91fd1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:23.930744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-05929946-4b67-4b16-a01e-0a4609f91fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:23.934123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 919/1857] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:23 2022] PUT /identity/v3/projects/d2503af5dc044e00b5ea1884221f15d0/users/0a206e67e46a4d259e3096f259c8f588/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:23.944393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b0a39-b728-44c1-a3b8-9d4449b883e9 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:23.944697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b0a39-b728-44c1-a3b8-9d4449b883e9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:23.944967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b0a39-b728-44c1-a3b8-9d4449b883e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.005289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-692b0a39-b728-44c1-a3b8-9d4449b883e9 None None] MFA Rules not processed for user `0a206e67e46a4d259e3096f259c8f588`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:24.006623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-692b0a39-b728-44c1-a3b8-9d4449b883e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:24.043621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05929946-4b67-4b16-a01e-0a4609f91fd1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:24.089887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:24.120540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 920/1858] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:23 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:24.122809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b0a39-b728-44c1-a3b8-9d4449b883e9 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:24.162700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da6b81-44e6-4b02-ad60-0a3518bfda07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:24.164832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da6b81-44e6-4b02-ad60-0a3518bfda07 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.165105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da6b81-44e6-4b02-ad60-0a3518bfda07 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.166301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da6b81-44e6-4b02-ad60-0a3518bfda07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.229086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:24.242649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b0a39-b728-44c1-a3b8-9d4449b883e9 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:24.248968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c95ca-64a7-4efe-ad6e-762a9f807c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:24.249769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c95ca-64a7-4efe-ad6e-762a9f807c10 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.250044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c95ca-64a7-4efe-ad6e-762a9f807c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.250261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c95ca-64a7-4efe-ad6e-762a9f807c10 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.250912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c95ca-64a7-4efe-ad6e-762a9f807c10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:24.253756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c95ca-64a7-4efe-ad6e-762a9f807c10 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:24.273704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da6b81-44e6-4b02-ad60-0a3518bfda07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:24.278091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0da6b81-44e6-4b02-ad60-0a3518bfda07 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:24.294345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 921/1859] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:24 2022] POST /identity/v3/projects => generated 399 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:24.295663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c95ca-64a7-4efe-ad6e-762a9f807c10 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:24.309458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 939/1860] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:24.343534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e135-d5cd-4aca-be62-456436e5aa97 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.344328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e135-d5cd-4aca-be62-456436e5aa97 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.344822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e135-d5cd-4aca-be62-456436e5aa97 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.346573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 940/1861] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:49:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 17 00:49:24.359335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0fc1c-9dc6-4fa1-91c8-14091f961341 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.359723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0fc1c-9dc6-4fa1-91c8-14091f961341 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.360150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0fc1c-9dc6-4fa1-91c8-14091f961341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.408698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-28f0fc1c-9dc6-4fa1-91c8-14091f961341 None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:24.410434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-28f0fc1c-9dc6-4fa1-91c8-14091f961341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:24.492953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c95ca-64a7-4efe-ad6e-762a9f807c10 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:24.507640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8f76a-a516-43d0-8816-e8d386751f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:24.508280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8f76a-a516-43d0-8816-e8d386751f1b admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.508565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8f76a-a516-43d0-8816-e8d386751f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.508819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce8f76a-a516-43d0-8816-e8d386751f1b admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.509509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8f76a-a516-43d0-8816-e8d386751f1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:24.518400 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce8f76a-a516-43d0-8816-e8d386751f1b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:24.566125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 922/1862] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:24 2022] POST /identity/v3/users => generated 306 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:24.570784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8f76a-a516-43d0-8816-e8d386751f1b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:24.594244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce8f76a-a516-43d0-8816-e8d386751f1b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:24.600083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 941/1863] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:24.602939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23138d4-b875-45f8-b0cb-0767b9a4dcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:24.603854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23138d4-b875-45f8-b0cb-0767b9a4dcde admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.604329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23138d4-b875-45f8-b0cb-0767b9a4dcde admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.604756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23138d4-b875-45f8-b0cb-0767b9a4dcde admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.606644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23138d4-b875-45f8-b0cb-0767b9a4dcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:24.609175 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23138d4-b875-45f8-b0cb-0767b9a4dcde admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:24.615485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0fc1c-9dc6-4fa1-91c8-14091f961341 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:24.617650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-28f0fc1c-9dc6-4fa1-91c8-14091f961341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:24.624769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 923/1864] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:24.625809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23138d4-b875-45f8-b0cb-0767b9a4dcde admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:24.639379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23138d4-b875-45f8-b0cb-0767b9a4dcde admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:24.646147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0fc1c-9dc6-4fa1-91c8-14091f961341 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:24.647740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f8490-3058-4365-ab11-470d27a29349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:24.648629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f8490-3058-4365-ab11-470d27a29349 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.649113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f8490-3058-4365-ab11-470d27a29349 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.649484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73f8490-3058-4365-ab11-470d27a29349 admin admin] PATH_INFO: `/v3/projects/81a6c1943c3b48a49a710235c15ebb69/users/32809d7492e74b88aeb379227e7cd649/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.661756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d9738-b987-4bca-861c-70cc07cfc4dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:24.662541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9738-b987-4bca-861c-70cc07cfc4dc service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.663012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9738-b987-4bca-861c-70cc07cfc4dc service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.663350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d9738-b987-4bca-861c-70cc07cfc4dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.684849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d9738-b987-4bca-861c-70cc07cfc4dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:24.688731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d9738-b987-4bca-861c-70cc07cfc4dc service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:24.695056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f8490-3058-4365-ab11-470d27a29349 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a6c1943c3b48a49a710235c15ebb69, user_id=32809d7492e74b88aeb379227e7cd649, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:24.698879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73f8490-3058-4365-ab11-470d27a29349 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:24.709187 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 942/1865] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:24.717917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 924/1866] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:24 2022] PUT /identity/v3/projects/81a6c1943c3b48a49a710235c15ebb69/users/32809d7492e74b88aeb379227e7cd649/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:24.721640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d9738-b987-4bca-861c-70cc07cfc4dc service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:24.732612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d9738-b987-4bca-861c-70cc07cfc4dc service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:24.832159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6123e85e-bd2b-4d10-863f-cc72d6298542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:24.833323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123e85e-bd2b-4d10-863f-cc72d6298542 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.833739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123e85e-bd2b-4d10-863f-cc72d6298542 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.834104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6123e85e-bd2b-4d10-863f-cc72d6298542 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.835037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123e85e-bd2b-4d10-863f-cc72d6298542 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:24.837277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6123e85e-bd2b-4d10-863f-cc72d6298542 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:24.851979 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 943/1867] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:24 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:24.856174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f8490-3058-4365-ab11-470d27a29349 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:24.871120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73f8490-3058-4365-ab11-470d27a29349 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:24.882927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c505-063e-4361-bc4d-a71825d30da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:24.884102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c505-063e-4361-bc4d-a71825d30da5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.884629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c505-063e-4361-bc4d-a71825d30da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.885877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155c505-063e-4361-bc4d-a71825d30da5 admin admin] PATH_INFO: `/v3/projects/81a6c1943c3b48a49a710235c15ebb69/users/32809d7492e74b88aeb379227e7cd649/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.890347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155c505-063e-4361-bc4d-a71825d30da5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81a6c1943c3b48a49a710235c15ebb69, user_id=32809d7492e74b88aeb379227e7cd649, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:24.896570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155c505-063e-4361-bc4d-a71825d30da5 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:24.921869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 925/1868] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:24 2022] PUT /identity/v3/projects/81a6c1943c3b48a49a710235c15ebb69/users/32809d7492e74b88aeb379227e7cd649/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:24.933424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ece00-5d65-4d08-a86d-570367376186 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:24.934119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ece00-5d65-4d08-a86d-570367376186 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:24.934541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ece00-5d65-4d08-a86d-570367376186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:24.982132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e38ece00-5d65-4d08-a86d-570367376186 None None] MFA Rules not processed for user `32809d7492e74b88aeb379227e7cd649`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:24.983743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e38ece00-5d65-4d08-a86d-570367376186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:25.045458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:25.136494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 944/1869] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:24 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:25.151136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c505-063e-4361-bc4d-a71825d30da5 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:25.154982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d155c505-063e-4361-bc4d-a71825d30da5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:25.178456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:25.255817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155c505-063e-4361-bc4d-a71825d30da5 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:25.260404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3aead-1872-4785-94ab-f18c29222216 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:25.261076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3aead-1872-4785-94ab-f18c29222216 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:25.261479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3aead-1872-4785-94ab-f18c29222216 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:25.262417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3aead-1872-4785-94ab-f18c29222216 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:25.272984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3aead-1872-4785-94ab-f18c29222216 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:25.274591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3aead-1872-4785-94ab-f18c29222216 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:25.285257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 926/1870] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:25 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:25.397168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ece00-5d65-4d08-a86d-570367376186 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:25.398695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e38ece00-5d65-4d08-a86d-570367376186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:25.402515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3aead-1872-4785-94ab-f18c29222216 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:25.415567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3aead-1872-4785-94ab-f18c29222216 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:25.425523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7390738-914a-4a7c-ad42-f822c0754884 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:25.426446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7390738-914a-4a7c-ad42-f822c0754884 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:25.426893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7390738-914a-4a7c-ad42-f822c0754884 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:25.427330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7390738-914a-4a7c-ad42-f822c0754884 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:25.525521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ece00-5d65-4d08-a86d-570367376186 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:25.529667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7390738-914a-4a7c-ad42-f822c0754884 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:25.530716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:25.531234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7390738-914a-4a7c-ad42-f822c0754884 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:25.531581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:25.531954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:25.532375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] PATH_INFO: `/v3/projects/0bc63a8c60354fd8a8f684ff6b6f2914` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:25.533658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bc63a8c60354fd8a8f684ff6b6f2914)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:25.536729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:25.558415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 927/1871] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:25 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:49:25.602618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bc63a8c60354fd8a8f684ff6b6f2914', 'request_id': 'req-bc7e6246-5336-4364-89e4-396cb3f98c46'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:25.614326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bc63a8c60354fd8a8f684ff6b6f2914', 'request_id': 'req-bc7e6246-5336-4364-89e4-396cb3f98c46'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:25.622493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bc63a8c60354fd8a8f684ff6b6f2914', 'request_id': 'req-bc7e6246-5336-4364-89e4-396cb3f98c46'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:25.639961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] The token cache is being invalidate because project 0bc63a8c60354fd8a8f684ff6b6f2914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:25.640390 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:25.641188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-bc7e6246-5336-4364-89e4-396cb3f98c46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:25.643045 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 945/1872] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:25 2022] DELETE /identity/v3/projects/0bc63a8c60354fd8a8f684ff6b6f2914 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:25.649381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4508bb-d0c1-4634-992a-8b2e578e8f84 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:25.649963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4508bb-d0c1-4634-992a-8b2e578e8f84 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:25.651121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4508bb-d0c1-4634-992a-8b2e578e8f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:25.708395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-de4508bb-d0c1-4634-992a-8b2e578e8f84 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:25.710108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-de4508bb-d0c1-4634-992a-8b2e578e8f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:25.792532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 928/1873] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:25.801555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d006af-df29-4652-a80d-8ef1df1ddeb1 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:25.801907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d006af-df29-4652-a80d-8ef1df1ddeb1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:25.802271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d006af-df29-4652-a80d-8ef1df1ddeb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:25.828874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-36d006af-df29-4652-a80d-8ef1df1ddeb1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:25.830427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-36d006af-df29-4652-a80d-8ef1df1ddeb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:25.846503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4508bb-d0c1-4634-992a-8b2e578e8f84 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:25.849582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 946/1874] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:25.866121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4508bb-d0c1-4634-992a-8b2e578e8f84 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:25.881232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10238cf1-05d2-4b7d-aae0-4cca817406c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:25.882022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10238cf1-05d2-4b7d-aae0-4cca817406c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:25.882308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10238cf1-05d2-4b7d-aae0-4cca817406c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:25.882582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10238cf1-05d2-4b7d-aae0-4cca817406c1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:25.883241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10238cf1-05d2-4b7d-aae0-4cca817406c1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:25.883546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10238cf1-05d2-4b7d-aae0-4cca817406c1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:25.885445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10238cf1-05d2-4b7d-aae0-4cca817406c1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:25.902105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 929/1875] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:25.907845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d006af-df29-4652-a80d-8ef1df1ddeb1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:25.936122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d006af-df29-4652-a80d-8ef1df1ddeb1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:25.952113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e020d0-96f5-4a4d-b4fd-2d229d87e17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:25.952956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e020d0-96f5-4a4d-b4fd-2d229d87e17f admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:25.953312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e020d0-96f5-4a4d-b4fd-2d229d87e17f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:25.953687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e020d0-96f5-4a4d-b4fd-2d229d87e17f admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:25.954444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e020d0-96f5-4a4d-b4fd-2d229d87e17f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:25.957858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e020d0-96f5-4a4d-b4fd-2d229d87e17f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:26.004942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 947/1876] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:25 2022] POST /identity/v3/projects => generated 363 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:26.006277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10238cf1-05d2-4b7d-aae0-4cca817406c1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:26.020796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10238cf1-05d2-4b7d-aae0-4cca817406c1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:26.070885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:26.093284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa90926-8cf4-453b-959c-44d006e5869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:26.093997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa90926-8cf4-453b-959c-44d006e5869e admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:26.094379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa90926-8cf4-453b-959c-44d006e5869e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:26.094755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa90926-8cf4-453b-959c-44d006e5869e admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:26.096052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa90926-8cf4-453b-959c-44d006e5869e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:26.099164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa90926-8cf4-453b-959c-44d006e5869e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:26.125773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 930/1877] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:26 2022] POST /identity/v3/users => generated 282 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:26.135539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e020d0-96f5-4a4d-b4fd-2d229d87e17f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:26.149245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e020d0-96f5-4a4d-b4fd-2d229d87e17f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:26.158263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca435e-11b0-491c-af67-a30521d9a157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:26.159000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca435e-11b0-491c-af67-a30521d9a157 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:26.159751 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca435e-11b0-491c-af67-a30521d9a157 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:26.160123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca435e-11b0-491c-af67-a30521d9a157 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:26.161086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca435e-11b0-491c-af67-a30521d9a157 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:26.162851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca435e-11b0-491c-af67-a30521d9a157 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:26.175376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 948/1878] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:26.179242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa90926-8cf4-453b-959c-44d006e5869e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:26.190047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa90926-8cf4-453b-959c-44d006e5869e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:26.195405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381ddc7-0e18-49ac-8d64-ade49dea732c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:26.195959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381ddc7-0e18-49ac-8d64-ade49dea732c admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:26.196238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381ddc7-0e18-49ac-8d64-ade49dea732c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:26.196512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381ddc7-0e18-49ac-8d64-ade49dea732c admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:26.197167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381ddc7-0e18-49ac-8d64-ade49dea732c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:26.198810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381ddc7-0e18-49ac-8d64-ade49dea732c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:26.211143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 931/1879] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:26.215793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca435e-11b0-491c-af67-a30521d9a157 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:26.226425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca435e-11b0-491c-af67-a30521d9a157 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:26.231388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6acd-35a2-4100-b9ce-43913ae47246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:26.232044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6acd-35a2-4100-b9ce-43913ae47246 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:26.232327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6acd-35a2-4100-b9ce-43913ae47246 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:26.232602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c6acd-35a2-4100-b9ce-43913ae47246 admin admin] PATH_INFO: `/v3/projects/c1e4d7edaf9449dd9ac0471807d63cd0/users/615f5f4e10234884806f9c6ae834842d/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:26.248193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6acd-35a2-4100-b9ce-43913ae47246 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1e4d7edaf9449dd9ac0471807d63cd0, user_id=615f5f4e10234884806f9c6ae834842d, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:26.251295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c6acd-35a2-4100-b9ce-43913ae47246 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:26.254324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:26.267431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 949/1880] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:26 2022] PUT /identity/v3/projects/c1e4d7edaf9449dd9ac0471807d63cd0/users/615f5f4e10234884806f9c6ae834842d/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:26.277490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cdc51-efb4-4648-b353-689ef21aac32 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:26.277853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cdc51-efb4-4648-b353-689ef21aac32 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:26.278199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1cdc51-efb4-4648-b353-689ef21aac32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:26.306160 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-bf1cdc51-efb4-4648-b353-689ef21aac32 None None] MFA Rules not processed for user `615f5f4e10234884806f9c6ae834842d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:26.307369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bf1cdc51-efb4-4648-b353-689ef21aac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:26.388059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 932/1881] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:26.402619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6acd-35a2-4100-b9ce-43913ae47246 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:26.404359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2c3c6acd-35a2-4100-b9ce-43913ae47246 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:26.489170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c6acd-35a2-4100-b9ce-43913ae47246 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:26.493398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bcb5b2-9513-41d9-b519-abb119a1fed0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:26.493961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb5b2-9513-41d9-b519-abb119a1fed0 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:26.494260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb5b2-9513-41d9-b519-abb119a1fed0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:26.494509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bcb5b2-9513-41d9-b519-abb119a1fed0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:26.504933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcb5b2-9513-41d9-b519-abb119a1fed0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:26.506432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bcb5b2-9513-41d9-b519-abb119a1fed0 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:26.520289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 950/1882] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:30.193075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cdc51-efb4-4648-b353-689ef21aac32 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:30.194818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bf1cdc51-efb4-4648-b353-689ef21aac32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:30.266358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1cdc51-efb4-4648-b353-689ef21aac32 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:30.271368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:30.271504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:30.271781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:30.272055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] PATH_INFO: `/v3/users/0a206e67e46a4d259e3096f259c8f588` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:30.273179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a206e67e46a4d259e3096f259c8f588)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:30.275169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:30.322222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a206e67e46a4d259e3096f259c8f588'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:30.327035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:30.330925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a206e67e46a4d259e3096f259c8f588'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:30.331780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a206e67e46a4d259e3096f259c8f588'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:30.352501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a206e67e46a4d259e3096f259c8f588'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:30.359983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a206e67e46a4d259e3096f259c8f588'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:30.367008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 933/1883] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:30 2022] DELETE /identity/v3/users/0a206e67e46a4d259e3096f259c8f588 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:30.371562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764f434-6d72-4596-8310-c8de46fe7393 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:30.372412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764f434-6d72-4596-8310-c8de46fe7393 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:30.372690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2764f434-6d72-4596-8310-c8de46fe7393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:30.391941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2764f434-6d72-4596-8310-c8de46fe7393 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:30.393149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2764f434-6d72-4596-8310-c8de46fe7393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:30.460731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 951/1884] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:30.470672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:30.472632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:30.586959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106dd6a3-94f4-464f-ae39-4bb3f17814a4 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:30.591785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e262-6b06-4201-8d44-ff58a7e6327e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:30.592627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e262-6b06-4201-8d44-ff58a7e6327e service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:30.592908 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e262-6b06-4201-8d44-ff58a7e6327e service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:30.593181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b577e262-6b06-4201-8d44-ff58a7e6327e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:30.603853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577e262-6b06-4201-8d44-ff58a7e6327e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:30.605398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b577e262-6b06-4201-8d44-ff58a7e6327e service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:30.617522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 934/1885] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:31.053783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764f434-6d72-4596-8310-c8de46fe7393 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:31.055364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2764f434-6d72-4596-8310-c8de46fe7393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:31.084761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2764f434-6d72-4596-8310-c8de46fe7393 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:31.096513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:31.099682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:31.103779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:31.103779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] PATH_INFO: `/v3/projects/d2503af5dc044e00b5ea1884221f15d0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:31.105717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2503af5dc044e00b5ea1884221f15d0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:31.108299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:31.180065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2503af5dc044e00b5ea1884221f15d0', 'request_id': 'req-5778a2a1-7b7c-4cc3-8e29-e6470130682b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.197353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2503af5dc044e00b5ea1884221f15d0', 'request_id': 'req-5778a2a1-7b7c-4cc3-8e29-e6470130682b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.204208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2503af5dc044e00b5ea1884221f15d0', 'request_id': 'req-5778a2a1-7b7c-4cc3-8e29-e6470130682b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.216427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] The token cache is being invalidate because project d2503af5dc044e00b5ea1884221f15d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:31.216721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.217384 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.218910 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 952/1886] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:31 2022] DELETE /identity/v3/projects/d2503af5dc044e00b5ea1884221f15d0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:31.222904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e262-6b06-4201-8d44-ff58a7e6327e service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:31.233658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b577e262-6b06-4201-8d44-ff58a7e6327e service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:31.292771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:31.293390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:31.293709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:31.294000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] PATH_INFO: `/v3/users/32809d7492e74b88aeb379227e7cd649` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:31.295143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] RBAC: Authorizing `identity:delete_user(user_id=32809d7492e74b88aeb379227e7cd649)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:31.297247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:31.358762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32809d7492e74b88aeb379227e7cd649'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.367306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32809d7492e74b88aeb379227e7cd649'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.368102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32809d7492e74b88aeb379227e7cd649'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.382167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32809d7492e74b88aeb379227e7cd649'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.384396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:31.390972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9bc5ac7b-e3fd-4236-ac75-35ef6b7a010c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32809d7492e74b88aeb379227e7cd649'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.398344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 935/1887] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:31 2022] DELETE /identity/v3/users/32809d7492e74b88aeb379227e7cd649 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:31.717230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:31.718821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:31.748380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5778a2a1-7b7c-4cc3-8e29-e6470130682b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:31.778176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:31.835495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:31.837127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:31.837822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:31.838476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] PATH_INFO: `/v3/projects/81a6c1943c3b48a49a710235c15ebb69` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:31.840438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81a6c1943c3b48a49a710235c15ebb69)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:31.843755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:31.915111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81a6c1943c3b48a49a710235c15ebb69', 'request_id': 'req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.925368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81a6c1943c3b48a49a710235c15ebb69', 'request_id': 'req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.933467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81a6c1943c3b48a49a710235c15ebb69', 'request_id': 'req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.945562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] The token cache is being invalidate because project 81a6c1943c3b48a49a710235c15ebb69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:31.945931 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.946657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f9d5fa85-f7ee-476f-85a2-7469e978dfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:31.948452 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 953/1888] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:31 2022] DELETE /identity/v3/projects/81a6c1943c3b48a49a710235c15ebb69 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:31.953459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c429-6e76-47d1-b473-3ba7147eeae6 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:31.953752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c429-6e76-47d1-b473-3ba7147eeae6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:31.954026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5c429-6e76-47d1-b473-3ba7147eeae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:31.977140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b4d5c429-6e76-47d1-b473-3ba7147eeae6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:31.978456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b4d5c429-6e76-47d1-b473-3ba7147eeae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:32.052157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 936/1889] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:32.060612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654762e2-1d39-4366-8676-473bed8dc692 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:32.060612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654762e2-1d39-4366-8676-473bed8dc692 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:32.060612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654762e2-1d39-4366-8676-473bed8dc692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:32.080548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-654762e2-1d39-4366-8676-473bed8dc692 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:32.082858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-654762e2-1d39-4366-8676-473bed8dc692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:32.091328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 954/1890] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:32.095641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c429-6e76-47d1-b473-3ba7147eeae6 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:32.106187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5c429-6e76-47d1-b473-3ba7147eeae6 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:32.111509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab1bcd-989e-45ff-83b9-bef7f14a94f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:32.112153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab1bcd-989e-45ff-83b9-bef7f14a94f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:32.112432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab1bcd-989e-45ff-83b9-bef7f14a94f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:32.112708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab1bcd-989e-45ff-83b9-bef7f14a94f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:32.113343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab1bcd-989e-45ff-83b9-bef7f14a94f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:32.113679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab1bcd-989e-45ff-83b9-bef7f14a94f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:32.115320 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab1bcd-989e-45ff-83b9-bef7f14a94f9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:32.131465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 937/1891] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:49:32.137119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654762e2-1d39-4366-8676-473bed8dc692 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:32.151662 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654762e2-1d39-4366-8676-473bed8dc692 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:32.169127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196dee-a18a-4ff5-8065-1fba66f08f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:32.170001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196dee-a18a-4ff5-8065-1fba66f08f62 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:32.170428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196dee-a18a-4ff5-8065-1fba66f08f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:32.170849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0196dee-a18a-4ff5-8065-1fba66f08f62 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:32.171650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0196dee-a18a-4ff5-8065-1fba66f08f62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:32.173762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0196dee-a18a-4ff5-8065-1fba66f08f62 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:32.220655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 955/1892] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:32 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:32.225308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab1bcd-989e-45ff-83b9-bef7f14a94f9 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:32.242227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab1bcd-989e-45ff-83b9-bef7f14a94f9 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:32.325609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44597ca8-4950-4bd1-a5ca-5ccc1dba20fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:32.326430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44597ca8-4950-4bd1-a5ca-5ccc1dba20fd admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:32.326877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44597ca8-4950-4bd1-a5ca-5ccc1dba20fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:32.327808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44597ca8-4950-4bd1-a5ca-5ccc1dba20fd admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:32.331375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44597ca8-4950-4bd1-a5ca-5ccc1dba20fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:32.334739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44597ca8-4950-4bd1-a5ca-5ccc1dba20fd admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:32.367838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 938/1893] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:32 2022] POST /identity/v3/users => generated 286 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:32.371566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196dee-a18a-4ff5-8065-1fba66f08f62 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:32.384780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0196dee-a18a-4ff5-8065-1fba66f08f62 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:32.396372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865becc-29b6-4e8f-a648-dc53c19c52eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:32.397148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865becc-29b6-4e8f-a648-dc53c19c52eb admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:32.397590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865becc-29b6-4e8f-a648-dc53c19c52eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:32.398005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865becc-29b6-4e8f-a648-dc53c19c52eb admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:32.398801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865becc-29b6-4e8f-a648-dc53c19c52eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:32.400565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865becc-29b6-4e8f-a648-dc53c19c52eb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:32.422504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 956/1894] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:32.423824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44597ca8-4950-4bd1-a5ca-5ccc1dba20fd admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:32.440933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44597ca8-4950-4bd1-a5ca-5ccc1dba20fd admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:32.446167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72984027-bbce-476c-ace8-e4616a338b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:32.446788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72984027-bbce-476c-ace8-e4616a338b5a admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:32.447066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72984027-bbce-476c-ace8-e4616a338b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:32.447337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72984027-bbce-476c-ace8-e4616a338b5a admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:32.448068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72984027-bbce-476c-ace8-e4616a338b5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:32.450719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72984027-bbce-476c-ace8-e4616a338b5a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:32.467003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 939/1895] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:32 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:32.472680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865becc-29b6-4e8f-a648-dc53c19c52eb admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:32.487269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865becc-29b6-4e8f-a648-dc53c19c52eb admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:32.496499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c0bf9-103f-4592-bbd9-8a75de1b221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:32.497539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0bf9-103f-4592-bbd9-8a75de1b221d admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:32.498129 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0bf9-103f-4592-bbd9-8a75de1b221d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:32.498734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c0bf9-103f-4592-bbd9-8a75de1b221d admin admin] PATH_INFO: `/v3/projects/fec7b37e0843464b82a69bcfc20945fb/users/7c0bb9948413468e82b34ac43e338fc2/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:32.549178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c0bf9-103f-4592-bbd9-8a75de1b221d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec7b37e0843464b82a69bcfc20945fb, user_id=7c0bb9948413468e82b34ac43e338fc2, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:32.554338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c0bf9-103f-4592-bbd9-8a75de1b221d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:32.584833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 957/1896] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:32 2022] PUT /identity/v3/projects/fec7b37e0843464b82a69bcfc20945fb/users/7c0bb9948413468e82b34ac43e338fc2/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:32.589946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd4566-1b06-4e93-9d33-97ccaf1ffc88 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:32.590339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd4566-1b06-4e93-9d33-97ccaf1ffc88 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:32.590783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd4566-1b06-4e93-9d33-97ccaf1ffc88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:32.622990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-71cd4566-1b06-4e93-9d33-97ccaf1ffc88 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:32.624311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-71cd4566-1b06-4e93-9d33-97ccaf1ffc88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:32.692425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:32.709112 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 940/1897] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:32.719198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c0bf9-103f-4592-bbd9-8a75de1b221d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:32.720878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ca5c0bf9-103f-4592-bbd9-8a75de1b221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:32.776602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:32.782986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c0bf9-103f-4592-bbd9-8a75de1b221d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:32.787001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0f18a-2b41-49a5-867b-80aef4f88a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:32.787739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f18a-2b41-49a5-867b-80aef4f88a88 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:32.788026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f18a-2b41-49a5-867b-80aef4f88a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:32.788300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0f18a-2b41-49a5-867b-80aef4f88a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:32.800033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0f18a-2b41-49a5-867b-80aef4f88a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:32.802295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0f18a-2b41-49a5-867b-80aef4f88a88 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:32.817771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 958/1898] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:33.994434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fbe75-1e3e-48da-bf35-bba07b92126b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:33.994990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fbe75-1e3e-48da-bf35-bba07b92126b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:33.994990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fbe75-1e3e-48da-bf35-bba07b92126b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:34.065734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9b4fbe75-1e3e-48da-bf35-bba07b92126b None None] MFA Rules not processed for user `7c0bb9948413468e82b34ac43e338fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:34.067289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9b4fbe75-1e3e-48da-bf35-bba07b92126b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:34.342624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 941/1899] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:34.349193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0f18a-2b41-49a5-867b-80aef4f88a88 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:34.364303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0f18a-2b41-49a5-867b-80aef4f88a88 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:34.375174 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea691-643f-40ce-8f58-d6816848ccbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:34.375792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea691-643f-40ce-8f58-d6816848ccbc admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:34.376075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea691-643f-40ce-8f58-d6816848ccbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:34.376351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aea691-643f-40ce-8f58-d6816848ccbc admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:34.377007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aea691-643f-40ce-8f58-d6816848ccbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:34.384147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aea691-643f-40ce-8f58-d6816848ccbc admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:34.485236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 959/1900] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:34 2022] POST /identity/v3/projects => generated 373 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:34.488011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fbe75-1e3e-48da-bf35-bba07b92126b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:34.517457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fbe75-1e3e-48da-bf35-bba07b92126b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:34.632532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9205ec-cce0-4ad4-bb94-8b4793c121e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:34.633320 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9205ec-cce0-4ad4-bb94-8b4793c121e4 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:34.633704 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9205ec-cce0-4ad4-bb94-8b4793c121e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:34.633986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9205ec-cce0-4ad4-bb94-8b4793c121e4 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:34.634694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9205ec-cce0-4ad4-bb94-8b4793c121e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:34.636738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9205ec-cce0-4ad4-bb94-8b4793c121e4 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:34.662943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 942/1901] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:34 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:34.668434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea691-643f-40ce-8f58-d6816848ccbc admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:34.679746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aea691-643f-40ce-8f58-d6816848ccbc admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:34.686817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3bce-a696-44f0-9ba6-f7c6f0d83545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:34.687450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3bce-a696-44f0-9ba6-f7c6f0d83545 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:34.687735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3bce-a696-44f0-9ba6-f7c6f0d83545 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:34.688008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ee3bce-a696-44f0-9ba6-f7c6f0d83545 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:34.688658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee3bce-a696-44f0-9ba6-f7c6f0d83545 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:34.690813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ee3bce-a696-44f0-9ba6-f7c6f0d83545 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:34.703114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 960/1902] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:34.708136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9205ec-cce0-4ad4-bb94-8b4793c121e4 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:34.718845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9205ec-cce0-4ad4-bb94-8b4793c121e4 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:34.724579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78641583-924c-4320-b44b-c01d432811ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:34.725322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78641583-924c-4320-b44b-c01d432811ab admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:34.725710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78641583-924c-4320-b44b-c01d432811ab admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:34.726051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78641583-924c-4320-b44b-c01d432811ab admin admin] PATH_INFO: `/v3/projects/3badcee4587a4bd59feb4a60f81e0cea/users/783007383a094299bebc8fd69f6ccb46/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:34.745760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78641583-924c-4320-b44b-c01d432811ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=3badcee4587a4bd59feb4a60f81e0cea, user_id=783007383a094299bebc8fd69f6ccb46, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:34.748426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78641583-924c-4320-b44b-c01d432811ab admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:34.770164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 943/1903] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:34 2022] PUT /identity/v3/projects/3badcee4587a4bd59feb4a60f81e0cea/users/783007383a094299bebc8fd69f6ccb46/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:34.774051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3bce-a696-44f0-9ba6-f7c6f0d83545 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:34.789757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ee3bce-a696-44f0-9ba6-f7c6f0d83545 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:34.913728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460fa290-230b-42c6-9736-9e6b47f33506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:34.914683 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fa290-230b-42c6-9736-9e6b47f33506 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:34.915112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fa290-230b-42c6-9736-9e6b47f33506 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:34.915528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fa290-230b-42c6-9736-9e6b47f33506 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:34.916330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fa290-230b-42c6-9736-9e6b47f33506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:34.918123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460fa290-230b-42c6-9736-9e6b47f33506 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:34.937952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78641583-924c-4320-b44b-c01d432811ab admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:34.951449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 961/1904] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:34 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:34.954736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78641583-924c-4320-b44b-c01d432811ab admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:34.962206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d2e9a7-3f85-4cc7-8039-e3302ff01c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:34.962973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2e9a7-3f85-4cc7-8039-e3302ff01c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:34.963315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2e9a7-3f85-4cc7-8039-e3302ff01c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:34.963671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d2e9a7-3f85-4cc7-8039-e3302ff01c8d admin admin] PATH_INFO: `/v3/projects/3badcee4587a4bd59feb4a60f81e0cea/users/783007383a094299bebc8fd69f6ccb46/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:34.966219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2e9a7-3f85-4cc7-8039-e3302ff01c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3badcee4587a4bd59feb4a60f81e0cea, user_id=783007383a094299bebc8fd69f6ccb46, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:34.969882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d2e9a7-3f85-4cc7-8039-e3302ff01c8d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:34.994283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 944/1905] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:34 2022] PUT /identity/v3/projects/3badcee4587a4bd59feb4a60f81e0cea/users/783007383a094299bebc8fd69f6ccb46/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:36.482051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bef98-ed2c-49b3-8fd5-8db839fa12fe None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:36.482639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bef98-ed2c-49b3-8fd5-8db839fa12fe None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:36.482639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77bef98-ed2c-49b3-8fd5-8db839fa12fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:36.538445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d77bef98-ed2c-49b3-8fd5-8db839fa12fe None None] MFA Rules not processed for user `783007383a094299bebc8fd69f6ccb46`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:36.540971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d77bef98-ed2c-49b3-8fd5-8db839fa12fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:36.736545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 962/1906] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:36.746683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b6308-1774-41cc-8084-f06fdb5d28b5 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:36.747179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b6308-1774-41cc-8084-f06fdb5d28b5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:36.747179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50b6308-1774-41cc-8084-f06fdb5d28b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:36.770095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d50b6308-1774-41cc-8084-f06fdb5d28b5 None None] MFA Rules not processed for user `7c0bb9948413468e82b34ac43e338fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:36.771315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d50b6308-1774-41cc-8084-f06fdb5d28b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:36.819487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:36.855339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 945/1907] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:36 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:36.869251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bef98-ed2c-49b3-8fd5-8db839fa12fe None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:36.870982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d77bef98-ed2c-49b3-8fd5-8db839fa12fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:36.935486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:36.977651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77bef98-ed2c-49b3-8fd5-8db839fa12fe None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:36.983389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c507d90-96b7-4541-ac44-33ab607117fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:36.984110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507d90-96b7-4541-ac44-33ab607117fc service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:36.984455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507d90-96b7-4541-ac44-33ab607117fc service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:36.984797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c507d90-96b7-4541-ac44-33ab607117fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:36.995781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c507d90-96b7-4541-ac44-33ab607117fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:36.998407 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c507d90-96b7-4541-ac44-33ab607117fc service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:37.009664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 963/1908] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:36 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:49:43.698416 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b6308-1774-41cc-8084-f06fdb5d28b5 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:43.699906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d50b6308-1774-41cc-8084-f06fdb5d28b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:43.769030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50b6308-1774-41cc-8084-f06fdb5d28b5 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:43.773589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:43.774225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:43.774500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:43.774771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] PATH_INFO: `/v3/users/bdf9bccc62a3409991a6f6a52725ccaa` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:43.775880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdf9bccc62a3409991a6f6a52725ccaa)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:43.777847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:43.827849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdf9bccc62a3409991a6f6a52725ccaa'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:43.837834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdf9bccc62a3409991a6f6a52725ccaa'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:43.838600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdf9bccc62a3409991a6f6a52725ccaa'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:43.850941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdf9bccc62a3409991a6f6a52725ccaa'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:43.857967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdf9bccc62a3409991a6f6a52725ccaa'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:43.864803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 946/1909] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:43 2022] DELETE /identity/v3/users/bdf9bccc62a3409991a6f6a52725ccaa => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:43.869279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffb126-6c4f-46d3-be54-0c4b936120b9 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:43.869836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffb126-6c4f-46d3-be54-0c4b936120b9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:43.869836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dffb126-6c4f-46d3-be54-0c4b936120b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:43.889178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3dffb126-6c4f-46d3-be54-0c4b936120b9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:43.890409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3dffb126-6c4f-46d3-be54-0c4b936120b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:43.962189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 964/1910] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:43.976388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:43.977861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:44.037140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16eafff-eee3-45ad-88b8-7a8335cf36bd admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:44.040766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e16ad3-e691-4b42-9090-08e9842a05fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:44.041380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e16ad3-e691-4b42-9090-08e9842a05fb service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:44.041695 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e16ad3-e691-4b42-9090-08e9842a05fb service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:44.041971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e16ad3-e691-4b42-9090-08e9842a05fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:44.052246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e16ad3-e691-4b42-9090-08e9842a05fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:44.053759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e16ad3-e691-4b42-9090-08e9842a05fb service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:44.063828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 947/1911] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:44.349667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffb126-6c4f-46d3-be54-0c4b936120b9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:44.351167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3dffb126-6c4f-46d3-be54-0c4b936120b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:44.366194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dffb126-6c4f-46d3-be54-0c4b936120b9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:44.371224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:44.371976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:44.372888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:44.373843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] PATH_INFO: `/v3/projects/b1d77737b78344a5b179ec09312bf4f7` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:44.376218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1d77737b78344a5b179ec09312bf4f7)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:44.379367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:44.440339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1d77737b78344a5b179ec09312bf4f7', 'request_id': 'req-02112db4-1428-48dd-a58d-45a867002ad1'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.448068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1d77737b78344a5b179ec09312bf4f7', 'request_id': 'req-02112db4-1428-48dd-a58d-45a867002ad1'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.454125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1d77737b78344a5b179ec09312bf4f7', 'request_id': 'req-02112db4-1428-48dd-a58d-45a867002ad1'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.465311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] The token cache is being invalidate because project b1d77737b78344a5b179ec09312bf4f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:44.465650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.466296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.467944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 965/1912] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:44 2022] DELETE /identity/v3/projects/b1d77737b78344a5b179ec09312bf4f7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:44.472637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e16ad3-e691-4b42-9090-08e9842a05fb service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:44.482704 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e16ad3-e691-4b42-9090-08e9842a05fb service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:44.487188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:44.544937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:44.545579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:44.545859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:44.546136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] PATH_INFO: `/v3/users/59b7e68906eb435581b62949589cd7bd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:44.547301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b7e68906eb435581b62949589cd7bd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:44.549892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:44.602353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b7e68906eb435581b62949589cd7bd'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.613306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b7e68906eb435581b62949589cd7bd'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.614186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b7e68906eb435581b62949589cd7bd'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.631040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b7e68906eb435581b62949589cd7bd'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.638430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-eb52b0f5-2871-4213-ae24-2e0fd96a1973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b7e68906eb435581b62949589cd7bd'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:44.644968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 948/1913] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:44 2022] DELETE /identity/v3/users/59b7e68906eb435581b62949589cd7bd => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:44.930601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:44.932130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:44.970021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02112db4-1428-48dd-a58d-45a867002ad1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:45.026323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:45.062923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:45.063503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.063787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.064063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] PATH_INFO: `/v3/projects/0209b0eee0ff4334bf8a1af7f9e703e0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.065889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0209b0eee0ff4334bf8a1af7f9e703e0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:45.068081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:45.120724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0209b0eee0ff4334bf8a1af7f9e703e0', 'request_id': 'req-4fa954bf-25ae-4116-9fe9-87ce9293a72c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:45.130139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0209b0eee0ff4334bf8a1af7f9e703e0', 'request_id': 'req-4fa954bf-25ae-4116-9fe9-87ce9293a72c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:45.138353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0209b0eee0ff4334bf8a1af7f9e703e0', 'request_id': 'req-4fa954bf-25ae-4116-9fe9-87ce9293a72c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:45.149870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] The token cache is being invalidate because project 0209b0eee0ff4334bf8a1af7f9e703e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:45.150162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:45.150823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4fa954bf-25ae-4116-9fe9-87ce9293a72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:45.152520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 966/1914] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:44 2022] DELETE /identity/v3/projects/0209b0eee0ff4334bf8a1af7f9e703e0 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:45.157581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b3f6c-6f7b-4a61-a37e-2e4b42594ab9 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.158074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b3f6c-6f7b-4a61-a37e-2e4b42594ab9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.158176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b3f6c-6f7b-4a61-a37e-2e4b42594ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.183392 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-684b3f6c-6f7b-4a61-a37e-2e4b42594ab9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:45.184680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-684b3f6c-6f7b-4a61-a37e-2e4b42594ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:45.250804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 949/1915] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:45.260340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2c405-486a-4e7c-ad7a-a192d1a3a122 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.260630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2c405-486a-4e7c-ad7a-a192d1a3a122 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.260910 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba2c405-486a-4e7c-ad7a-a192d1a3a122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.282450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-1ba2c405-486a-4e7c-ad7a-a192d1a3a122 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:45.284234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1ba2c405-486a-4e7c-ad7a-a192d1a3a122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:45.295525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 967/1916] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:45.296782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b3f6c-6f7b-4a61-a37e-2e4b42594ab9 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:45.307462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684b3f6c-6f7b-4a61-a37e-2e4b42594ab9 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:45.312160 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff318293-4c9f-427e-9f97-aa76057af90e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:45.312790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318293-4c9f-427e-9f97-aa76057af90e admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.313139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318293-4c9f-427e-9f97-aa76057af90e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.313346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff318293-4c9f-427e-9f97-aa76057af90e admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.314083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff318293-4c9f-427e-9f97-aa76057af90e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:45.314393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff318293-4c9f-427e-9f97-aa76057af90e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:45.316026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff318293-4c9f-427e-9f97-aa76057af90e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:45.329699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 950/1917] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:45.334142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2c405-486a-4e7c-ad7a-a192d1a3a122 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:45.343962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba2c405-486a-4e7c-ad7a-a192d1a3a122 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:45.349181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758e04-511e-4c4a-8fba-59a3dd496946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:45.349868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758e04-511e-4c4a-8fba-59a3dd496946 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.350147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758e04-511e-4c4a-8fba-59a3dd496946 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.350423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06758e04-511e-4c4a-8fba-59a3dd496946 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.351069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06758e04-511e-4c4a-8fba-59a3dd496946 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:45.352991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06758e04-511e-4c4a-8fba-59a3dd496946 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:45.384387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 968/1918] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:45 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:45.388678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff318293-4c9f-427e-9f97-aa76057af90e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:45.399264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff318293-4c9f-427e-9f97-aa76057af90e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:45.409061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:45.474264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8b49c-9e82-4f8c-af42-c46f9df1b0e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:45.474881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8b49c-9e82-4f8c-af42-c46f9df1b0e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.475165 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8b49c-9e82-4f8c-af42-c46f9df1b0e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.475438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d8b49c-9e82-4f8c-af42-c46f9df1b0e7 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.476074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8b49c-9e82-4f8c-af42-c46f9df1b0e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:45.478057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d8b49c-9e82-4f8c-af42-c46f9df1b0e7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:45.502359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 951/1919] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:45 2022] POST /identity/v3/users => generated 284 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:45.506576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758e04-511e-4c4a-8fba-59a3dd496946 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:45.517370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06758e04-511e-4c4a-8fba-59a3dd496946 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:45.538685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54385f3-c683-482a-b70f-adc83c337d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:45.539321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54385f3-c683-482a-b70f-adc83c337d7a admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.539604 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54385f3-c683-482a-b70f-adc83c337d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.539880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54385f3-c683-482a-b70f-adc83c337d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.540547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54385f3-c683-482a-b70f-adc83c337d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:45.542207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54385f3-c683-482a-b70f-adc83c337d7a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:45.559434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 969/1920] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:45.563647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8b49c-9e82-4f8c-af42-c46f9df1b0e7 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:45.574050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d8b49c-9e82-4f8c-af42-c46f9df1b0e7 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:45.578876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7f74c-6300-49cf-b1e8-bdd6a3b66774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:45.579598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f74c-6300-49cf-b1e8-bdd6a3b66774 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.579886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f74c-6300-49cf-b1e8-bdd6a3b66774 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.580648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7f74c-6300-49cf-b1e8-bdd6a3b66774 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.581498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f74c-6300-49cf-b1e8-bdd6a3b66774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:45.583198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7f74c-6300-49cf-b1e8-bdd6a3b66774 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:45.594629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 952/1921] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:45.600002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54385f3-c683-482a-b70f-adc83c337d7a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:45.610215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54385f3-c683-482a-b70f-adc83c337d7a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:45.615816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09ac50-17cd-4081-bf42-7d2b77454ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:45.616610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09ac50-17cd-4081-bf42-7d2b77454ef1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.616891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09ac50-17cd-4081-bf42-7d2b77454ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.617166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c09ac50-17cd-4081-bf42-7d2b77454ef1 admin admin] PATH_INFO: `/v3/projects/90b79c7010b048f880e336ab4fed59f1/users/6db77caf144947368b11b2b08f1e8d79/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.635484 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09ac50-17cd-4081-bf42-7d2b77454ef1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b79c7010b048f880e336ab4fed59f1, user_id=6db77caf144947368b11b2b08f1e8d79, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:45.638180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c09ac50-17cd-4081-bf42-7d2b77454ef1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:45.652394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 970/1922] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:45 2022] PUT /identity/v3/projects/90b79c7010b048f880e336ab4fed59f1/users/6db77caf144947368b11b2b08f1e8d79/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:45.663311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567597ea-135f-46b4-8f4c-e857fa7e38c0 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.663718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567597ea-135f-46b4-8f4c-e857fa7e38c0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.664064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567597ea-135f-46b4-8f4c-e857fa7e38c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.693961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-567597ea-135f-46b4-8f4c-e857fa7e38c0 None None] MFA Rules not processed for user `6db77caf144947368b11b2b08f1e8d79`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:45.695235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-567597ea-135f-46b4-8f4c-e857fa7e38c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:45.776676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 953/1923] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:45.781438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09ac50-17cd-4081-bf42-7d2b77454ef1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:45.850869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c09ac50-17cd-4081-bf42-7d2b77454ef1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:45.855516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d6530-c3a7-4801-8e6f-6ed900bb7d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:45.856140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d6530-c3a7-4801-8e6f-6ed900bb7d58 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.856426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d6530-c3a7-4801-8e6f-6ed900bb7d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.856950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596d6530-c3a7-4801-8e6f-6ed900bb7d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.857334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d6530-c3a7-4801-8e6f-6ed900bb7d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:45.859632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596d6530-c3a7-4801-8e6f-6ed900bb7d58 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:45.885906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:45.895568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 971/1924] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:45 2022] POST /identity/v3/projects => generated 365 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:45.898901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567597ea-135f-46b4-8f4c-e857fa7e38c0 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:45.910823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567597ea-135f-46b4-8f4c-e857fa7e38c0 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:45.972208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1ff23-1fbc-431a-ae78-ffccac39c304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:45.972909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1ff23-1fbc-431a-ae78-ffccac39c304 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:45.976712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1ff23-1fbc-431a-ae78-ffccac39c304 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:45.976992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1ff23-1fbc-431a-ae78-ffccac39c304 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:45.977889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1ff23-1fbc-431a-ae78-ffccac39c304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:45.983797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1ff23-1fbc-431a-ae78-ffccac39c304 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:46.023409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 954/1925] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:45 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:46.027976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d6530-c3a7-4801-8e6f-6ed900bb7d58 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:46.041730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596d6530-c3a7-4801-8e6f-6ed900bb7d58 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:46.053654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf2373-2579-46eb-b87b-926168379694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:46.054643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf2373-2579-46eb-b87b-926168379694 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:46.055118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf2373-2579-46eb-b87b-926168379694 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:46.056097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf2373-2579-46eb-b87b-926168379694 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:46.056958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf2373-2579-46eb-b87b-926168379694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:46.058852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf2373-2579-46eb-b87b-926168379694 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:46.109767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 972/1926] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:46.134054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1ff23-1fbc-431a-ae78-ffccac39c304 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:46.148177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1ff23-1fbc-431a-ae78-ffccac39c304 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:46.153258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31ed22-65ae-442c-b2a7-e091cfb72861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:46.154088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31ed22-65ae-442c-b2a7-e091cfb72861 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:46.154450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31ed22-65ae-442c-b2a7-e091cfb72861 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:46.154791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa31ed22-65ae-442c-b2a7-e091cfb72861 admin admin] PATH_INFO: `/v3/projects/eff246e7401c4d249bbf4730142082c2/users/c740d97f36814561a89a42e2c35f1466/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:46.167191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:46.171808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31ed22-65ae-442c-b2a7-e091cfb72861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff246e7401c4d249bbf4730142082c2, user_id=c740d97f36814561a89a42e2c35f1466, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:46.175442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa31ed22-65ae-442c-b2a7-e091cfb72861 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:46.197448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 955/1927] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:46 2022] PUT /identity/v3/projects/eff246e7401c4d249bbf4730142082c2/users/c740d97f36814561a89a42e2c35f1466/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:46.199442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf2373-2579-46eb-b87b-926168379694 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:46.211131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf2373-2579-46eb-b87b-926168379694 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:46.330886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcf870e-b57f-4957-9e39-8d8b42db433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:46.331658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf870e-b57f-4957-9e39-8d8b42db433d admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:46.331942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf870e-b57f-4957-9e39-8d8b42db433d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:46.332606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf870e-b57f-4957-9e39-8d8b42db433d admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:46.333047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf870e-b57f-4957-9e39-8d8b42db433d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:46.334717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcf870e-b57f-4957-9e39-8d8b42db433d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:46.346491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 973/1928] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:46 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:46.350511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31ed22-65ae-442c-b2a7-e091cfb72861 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:46.362074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa31ed22-65ae-442c-b2a7-e091cfb72861 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:46.367322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ef76d-7f51-42d5-8424-7721fd1138ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:46.367981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ef76d-7f51-42d5-8424-7721fd1138ca admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:46.368258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ef76d-7f51-42d5-8424-7721fd1138ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:46.368568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302ef76d-7f51-42d5-8424-7721fd1138ca admin admin] PATH_INFO: `/v3/projects/eff246e7401c4d249bbf4730142082c2/users/c740d97f36814561a89a42e2c35f1466/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:46.371423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ef76d-7f51-42d5-8424-7721fd1138ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=eff246e7401c4d249bbf4730142082c2, user_id=c740d97f36814561a89a42e2c35f1466, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:46.375963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302ef76d-7f51-42d5-8424-7721fd1138ca admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:46.389434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 956/1929] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:46 2022] PUT /identity/v3/projects/eff246e7401c4d249bbf4730142082c2/users/c740d97f36814561a89a42e2c35f1466/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:46.396998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae73822-e7d8-4d26-b859-caac32fff412 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:46.397290 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae73822-e7d8-4d26-b859-caac32fff412 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:46.397608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae73822-e7d8-4d26-b859-caac32fff412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:46.434209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-5ae73822-e7d8-4d26-b859-caac32fff412 None None] MFA Rules not processed for user `c740d97f36814561a89a42e2c35f1466`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:46.435450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5ae73822-e7d8-4d26-b859-caac32fff412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:46.507953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 974/1930] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:46.520318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ef76d-7f51-42d5-8424-7721fd1138ca admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:46.521767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-302ef76d-7f51-42d5-8424-7721fd1138ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:46.631591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302ef76d-7f51-42d5-8424-7721fd1138ca admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:46.636241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d7de1-235c-4235-b00d-aba768096408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:46.636941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d7de1-235c-4235-b00d-aba768096408 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:46.637219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d7de1-235c-4235-b00d-aba768096408 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:46.637630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d7de1-235c-4235-b00d-aba768096408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:46.652533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d7de1-235c-4235-b00d-aba768096408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:46.654254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2d7de1-235c-4235-b00d-aba768096408 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:46.667757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 957/1931] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:46.782805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae73822-e7d8-4d26-b859-caac32fff412 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:46.804675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae73822-e7d8-4d26-b859-caac32fff412 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:46.808692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4495522c-8070-49ac-9ee5-915b6e9f4cc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:46.809504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495522c-8070-49ac-9ee5-915b6e9f4cc3 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:46.809843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495522c-8070-49ac-9ee5-915b6e9f4cc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:46.810819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4495522c-8070-49ac-9ee5-915b6e9f4cc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:46.886494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495522c-8070-49ac-9ee5-915b6e9f4cc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:46.887947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4495522c-8070-49ac-9ee5-915b6e9f4cc3 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:46.899631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 975/1932] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:49:48.911076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f497f0c-069c-4bd2-96b1-cea73f4b114b None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:48.911615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f497f0c-069c-4bd2-96b1-cea73f4b114b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:48.911786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f497f0c-069c-4bd2-96b1-cea73f4b114b None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:48.913275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 958/1933] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:49:48.947642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f6696-cbda-4251-ae75-3ab062839cf7 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:48.948251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f6696-cbda-4251-ae75-3ab062839cf7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:48.950049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68f6696-cbda-4251-ae75-3ab062839cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:48.966591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:48.980805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d68f6696-cbda-4251-ae75-3ab062839cf7 None None] MFA Rules not processed for user `47fef4612fbd4d00ad8de2a2144a2ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:48.982176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d68f6696-cbda-4251-ae75-3ab062839cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:49.026664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f497f0c-069c-4bd2-96b1-cea73f4b114b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:49.028581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1f497f0c-069c-4bd2-96b1-cea73f4b114b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:49.071381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 976/1934] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:49:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:49.093439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b52247-8e7e-4857-9abb-f9b9ea7e170b None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.093858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b52247-8e7e-4857-9abb-f9b9ea7e170b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.094125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b52247-8e7e-4857-9abb-f9b9ea7e170b None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.096399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 977/1935] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 17 00:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:49:49.102337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c73c9-9f77-43e1-bc14-1cd1335e3a36 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.102617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c73c9-9f77-43e1-bc14-1cd1335e3a36 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.102891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c73c9-9f77-43e1-bc14-1cd1335e3a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.128087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c01c73c9-9f77-43e1-bc14-1cd1335e3a36 None None] MFA Rules not processed for user `47fef4612fbd4d00ad8de2a2144a2ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:49.129389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c01c73c9-9f77-43e1-bc14-1cd1335e3a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:49.139789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 978/1936] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 17 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:49.149889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c73c9-9f77-43e1-bc14-1cd1335e3a36 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:49.162360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c73c9-9f77-43e1-bc14-1cd1335e3a36 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:49.169458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e7f3f-ead9-4e9f-9ecb-41c20055107d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:49.170200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e7f3f-ead9-4e9f-9ecb-41c20055107d service placement] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.170584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e7f3f-ead9-4e9f-9ecb-41c20055107d service placement] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.170941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e7f3f-ead9-4e9f-9ecb-41c20055107d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.183051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e7f3f-ead9-4e9f-9ecb-41c20055107d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:49.184812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e7f3f-ead9-4e9f-9ecb-41c20055107d service placement] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:49.189091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f497f0c-069c-4bd2-96b1-cea73f4b114b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:49.197299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 979/1937] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:49.203618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:49.204281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.204563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.204840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] PATH_INFO: `/v3/users/50262ab75897467e8342a486ed1fc94e` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.206090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=50262ab75897467e8342a486ed1fc94e)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:49.208034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:49.263748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50262ab75897467e8342a486ed1fc94e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.272257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50262ab75897467e8342a486ed1fc94e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.273141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50262ab75897467e8342a486ed1fc94e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.293252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50262ab75897467e8342a486ed1fc94e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.299699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:49.301795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-f077fa25-720e-4835-807a-7d017393a63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50262ab75897467e8342a486ed1fc94e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.313326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 959/1938] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:49 2022] DELETE /identity/v3/users/50262ab75897467e8342a486ed1fc94e => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:49.485530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e7f3f-ead9-4e9f-9ecb-41c20055107d service placement] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:49.498363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e7f3f-ead9-4e9f-9ecb-41c20055107d service placement] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:49.558194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:49.559154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.559712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.560167 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] PATH_INFO: `/v3/projects/c31a926edb174052b6be117414610eb9` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.561672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c31a926edb174052b6be117414610eb9)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:49.563624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:49.612862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c31a926edb174052b6be117414610eb9', 'request_id': 'req-11183f46-94ae-4762-8a93-1438d78b01fe'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.620609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c31a926edb174052b6be117414610eb9', 'request_id': 'req-11183f46-94ae-4762-8a93-1438d78b01fe'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.631415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c31a926edb174052b6be117414610eb9', 'request_id': 'req-11183f46-94ae-4762-8a93-1438d78b01fe'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.644055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] The token cache is being invalidate because project c31a926edb174052b6be117414610eb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:49.644342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.645009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-11183f46-94ae-4762-8a93-1438d78b01fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:49.646570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 980/1939] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:49 2022] DELETE /identity/v3/projects/c31a926edb174052b6be117414610eb9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:49.651425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936d470-5ec4-44c6-a060-beb390758846 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.651735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936d470-5ec4-44c6-a060-beb390758846 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.652011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5936d470-5ec4-44c6-a060-beb390758846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.673885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-5936d470-5ec4-44c6-a060-beb390758846 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:49.675082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5936d470-5ec4-44c6-a060-beb390758846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:49.734249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 960/1940] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:49.741809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b685ba-5213-4836-9fe2-1ac913c349c6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.742201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b685ba-5213-4836-9fe2-1ac913c349c6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.742541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b685ba-5213-4836-9fe2-1ac913c349c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.764391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f0b685ba-5213-4836-9fe2-1ac913c349c6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:49.765641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f0b685ba-5213-4836-9fe2-1ac913c349c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:49.774861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 981/1941] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:49.780684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936d470-5ec4-44c6-a060-beb390758846 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:49.790412 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5936d470-5ec4-44c6-a060-beb390758846 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:49.795244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdb8db-919d-4c29-95d5-46d72427ada6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:49.795856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdb8db-919d-4c29-95d5-46d72427ada6 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.796137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdb8db-919d-4c29-95d5-46d72427ada6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.796410 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cdb8db-919d-4c29-95d5-46d72427ada6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.797057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdb8db-919d-4c29-95d5-46d72427ada6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:49.797359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdb8db-919d-4c29-95d5-46d72427ada6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:49.799034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cdb8db-919d-4c29-95d5-46d72427ada6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:49.811071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 961/1942] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:49.816024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b685ba-5213-4836-9fe2-1ac913c349c6 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:49.825131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b685ba-5213-4836-9fe2-1ac913c349c6 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:49.829802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fb86-7307-49a4-8d69-872fa99f99c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:49.831079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fb86-7307-49a4-8d69-872fa99f99c8 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.831362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fb86-7307-49a4-8d69-872fa99f99c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.831638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2596fb86-7307-49a4-8d69-872fa99f99c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.832271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596fb86-7307-49a4-8d69-872fa99f99c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:49.834302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2596fb86-7307-49a4-8d69-872fa99f99c8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:49.841657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:49.867560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 982/1943] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:49 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:49.871801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdb8db-919d-4c29-95d5-46d72427ada6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:49.882426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cdb8db-919d-4c29-95d5-46d72427ada6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:49.941558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b162ee4-2b78-4604-b3e0-78b4a4d8f722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:49.942168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b162ee4-2b78-4604-b3e0-78b4a4d8f722 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.942445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b162ee4-2b78-4604-b3e0-78b4a4d8f722 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.942715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b162ee4-2b78-4604-b3e0-78b4a4d8f722 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.943360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b162ee4-2b78-4604-b3e0-78b4a4d8f722 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:49.945621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b162ee4-2b78-4604-b3e0-78b4a4d8f722 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:49.969545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 962/1944] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:49 2022] POST /identity/v3/users => generated 287 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:49.974015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fb86-7307-49a4-8d69-872fa99f99c8 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:49.984362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2596fb86-7307-49a4-8d69-872fa99f99c8 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:49.988914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8633ad-196d-4566-abe9-67e1b87b2c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:49.989546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8633ad-196d-4566-abe9-67e1b87b2c87 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:49.989825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8633ad-196d-4566-abe9-67e1b87b2c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:49.990097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8633ad-196d-4566-abe9-67e1b87b2c87 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:49.990740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8633ad-196d-4566-abe9-67e1b87b2c87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:49.992579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8633ad-196d-4566-abe9-67e1b87b2c87 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:50.003475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 983/1945] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:50.007720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b162ee4-2b78-4604-b3e0-78b4a4d8f722 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:50.019541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b162ee4-2b78-4604-b3e0-78b4a4d8f722 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:50.024514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ec9cc-a1f1-44c6-a112-7075d7f08a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:50.025141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec9cc-a1f1-44c6-a112-7075d7f08a84 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:50.025447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec9cc-a1f1-44c6-a112-7075d7f08a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:50.025731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ec9cc-a1f1-44c6-a112-7075d7f08a84 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:50.026382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec9cc-a1f1-44c6-a112-7075d7f08a84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:50.027985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ec9cc-a1f1-44c6-a112-7075d7f08a84 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:50.039237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 963/1946] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:50.043541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8633ad-196d-4566-abe9-67e1b87b2c87 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:50.055416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8633ad-196d-4566-abe9-67e1b87b2c87 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:50.060747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3cdac-f6b3-4aa0-91b3-e16275c2e203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:50.061392 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3cdac-f6b3-4aa0-91b3-e16275c2e203 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:50.061703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3cdac-f6b3-4aa0-91b3-e16275c2e203 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:50.062113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc3cdac-f6b3-4aa0-91b3-e16275c2e203 admin admin] PATH_INFO: `/v3/projects/8190fb8518d94a1eb539177bbb02855e/users/ce23ec41b7fb4f00891248732936824e/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:50.080352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3cdac-f6b3-4aa0-91b3-e16275c2e203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8190fb8518d94a1eb539177bbb02855e, user_id=ce23ec41b7fb4f00891248732936824e, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:50.083639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc3cdac-f6b3-4aa0-91b3-e16275c2e203 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:50.116140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 984/1947] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:50 2022] PUT /identity/v3/projects/8190fb8518d94a1eb539177bbb02855e/users/ce23ec41b7fb4f00891248732936824e/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:50.116245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8f4b-de9d-4765-876b-76db5d0103ed None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:50.116338 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8f4b-de9d-4765-876b-76db5d0103ed None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:50.116595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc8f4b-de9d-4765-876b-76db5d0103ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:50.149674 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-c8fc8f4b-de9d-4765-876b-76db5d0103ed None None] MFA Rules not processed for user `ce23ec41b7fb4f00891248732936824e`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:50.151030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c8fc8f4b-de9d-4765-876b-76db5d0103ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:50.210474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:50.238836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 964/1948] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:50.249625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3cdac-f6b3-4aa0-91b3-e16275c2e203 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:50.251328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4dc3cdac-f6b3-4aa0-91b3-e16275c2e203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:50.341637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc3cdac-f6b3-4aa0-91b3-e16275c2e203 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:50.348419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b555e85-b0e4-4015-a633-059155531073 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:50.349288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b555e85-b0e4-4015-a633-059155531073 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:50.349742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b555e85-b0e4-4015-a633-059155531073 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:50.350194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b555e85-b0e4-4015-a633-059155531073 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:50.362761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b555e85-b0e4-4015-a633-059155531073 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:50.364655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b555e85-b0e4-4015-a633-059155531073 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:50.388161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 985/1949] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:50.641696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc8f4b-de9d-4765-876b-76db5d0103ed None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:50.710584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc8f4b-de9d-4765-876b-76db5d0103ed None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:50.719555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:50.720202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:50.720477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:50.721236 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] PATH_INFO: `/v3/users/ce23ec41b7fb4f00891248732936824e` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:50.722443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce23ec41b7fb4f00891248732936824e)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:50.724371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:50.777541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce23ec41b7fb4f00891248732936824e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:50.787517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce23ec41b7fb4f00891248732936824e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:50.788134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce23ec41b7fb4f00891248732936824e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:50.802092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce23ec41b7fb4f00891248732936824e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:50.809249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce23ec41b7fb4f00891248732936824e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:50.825144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 965/1950] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:50 2022] DELETE /identity/v3/users/ce23ec41b7fb4f00891248732936824e => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:50.825243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af96c6-fe9f-435b-ad4f-2ba55d9b00a2 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:50.825243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af96c6-fe9f-435b-ad4f-2ba55d9b00a2 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:50.825243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72af96c6-fe9f-435b-ad4f-2ba55d9b00a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:50.842424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-72af96c6-fe9f-435b-ad4f-2ba55d9b00a2 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:50.843679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-72af96c6-fe9f-435b-ad4f-2ba55d9b00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:50.912804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 986/1951] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:50.923029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:50.924516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:50.981796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1721b50-98c9-4df0-b269-f9e8bc1e56cd admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:50.985517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d111ae8-9c7c-4bb3-8987-497b920bbf63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:50.986144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d111ae8-9c7c-4bb3-8987-497b920bbf63 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:50.986448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d111ae8-9c7c-4bb3-8987-497b920bbf63 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:50.986722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d111ae8-9c7c-4bb3-8987-497b920bbf63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:50.996481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d111ae8-9c7c-4bb3-8987-497b920bbf63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:50.997939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d111ae8-9c7c-4bb3-8987-497b920bbf63 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:51.008651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 966/1952] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:51.305331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af96c6-fe9f-435b-ad4f-2ba55d9b00a2 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:51.308073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-72af96c6-fe9f-435b-ad4f-2ba55d9b00a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:51.330360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72af96c6-fe9f-435b-ad4f-2ba55d9b00a2 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:51.341977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:51.343092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:51.343616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:51.344261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] PATH_INFO: `/v3/projects/8190fb8518d94a1eb539177bbb02855e` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:51.345958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8190fb8518d94a1eb539177bbb02855e)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:51.348061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:51.388888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:51.403320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8190fb8518d94a1eb539177bbb02855e', 'request_id': 'req-e6557c5d-50a0-428a-86e6-a566dadcfa96'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:51.411732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8190fb8518d94a1eb539177bbb02855e', 'request_id': 'req-e6557c5d-50a0-428a-86e6-a566dadcfa96'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:51.420685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8190fb8518d94a1eb539177bbb02855e', 'request_id': 'req-e6557c5d-50a0-428a-86e6-a566dadcfa96'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:51.432993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] The token cache is being invalidate because project 8190fb8518d94a1eb539177bbb02855e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:51.433851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:51.434618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e6557c5d-50a0-428a-86e6-a566dadcfa96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:51.436266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 987/1953] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:51 2022] DELETE /identity/v3/projects/8190fb8518d94a1eb539177bbb02855e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:51.441342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18908b74-25f1-4318-a016-d18d0085e6f8 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:51.441660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18908b74-25f1-4318-a016-d18d0085e6f8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:51.441951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18908b74-25f1-4318-a016-d18d0085e6f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:51.464197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-18908b74-25f1-4318-a016-d18d0085e6f8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:51.466214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-18908b74-25f1-4318-a016-d18d0085e6f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:51.480985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:51.552048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 967/1954] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:51.554812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc20d-794b-49c9-9c36-6af2f528b88e None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:51.555350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc20d-794b-49c9-9c36-6af2f528b88e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:51.555729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fc20d-794b-49c9-9c36-6af2f528b88e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:51.598218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-228fc20d-794b-49c9-9c36-6af2f528b88e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:51.599633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-228fc20d-794b-49c9-9c36-6af2f528b88e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:51.611356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 988/1955] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:51.619430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18908b74-25f1-4318-a016-d18d0085e6f8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:51.629230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18908b74-25f1-4318-a016-d18d0085e6f8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:51.635472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57779e3e-ee3a-40f4-856d-978f8635c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:51.636641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57779e3e-ee3a-40f4-856d-978f8635c741 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:51.637382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57779e3e-ee3a-40f4-856d-978f8635c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:51.637813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57779e3e-ee3a-40f4-856d-978f8635c741 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:51.639018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57779e3e-ee3a-40f4-856d-978f8635c741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:51.640521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57779e3e-ee3a-40f4-856d-978f8635c741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:51.642563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57779e3e-ee3a-40f4-856d-978f8635c741 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:51.657450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 968/1956] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:51.662242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc20d-794b-49c9-9c36-6af2f528b88e None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:51.671776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fc20d-794b-49c9-9c36-6af2f528b88e None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:51.679257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485faad3-05fe-49b1-b266-67c6f0c4633b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:51.680081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485faad3-05fe-49b1-b266-67c6f0c4633b admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:51.680366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485faad3-05fe-49b1-b266-67c6f0c4633b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:51.680677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485faad3-05fe-49b1-b266-67c6f0c4633b admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:51.681438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485faad3-05fe-49b1-b266-67c6f0c4633b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:51.683745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485faad3-05fe-49b1-b266-67c6f0c4633b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:51.718414 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 989/1957] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:51 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:51.723187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57779e3e-ee3a-40f4-856d-978f8635c741 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:51.733847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57779e3e-ee3a-40f4-856d-978f8635c741 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:51.813645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2671c-aea2-4ed0-a8e5-7645a054025c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:51.814153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2671c-aea2-4ed0-a8e5-7645a054025c admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:51.814439 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2671c-aea2-4ed0-a8e5-7645a054025c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:51.814715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2671c-aea2-4ed0-a8e5-7645a054025c admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:51.815458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2671c-aea2-4ed0-a8e5-7645a054025c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:51.817518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2671c-aea2-4ed0-a8e5-7645a054025c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:51.861701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 969/1958] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:51 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:51.866015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485faad3-05fe-49b1-b266-67c6f0c4633b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:51.880861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485faad3-05fe-49b1-b266-67c6f0c4633b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:51.886186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d456-ee06-446a-ad09-d0128c5dbab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:51.886875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d456-ee06-446a-ad09-d0128c5dbab7 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:51.887152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d456-ee06-446a-ad09-d0128c5dbab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:51.887415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713d456-ee06-446a-ad09-d0128c5dbab7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:51.888057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713d456-ee06-446a-ad09-d0128c5dbab7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:51.889839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b713d456-ee06-446a-ad09-d0128c5dbab7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:51.901743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 990/1959] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:51.906458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2671c-aea2-4ed0-a8e5-7645a054025c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:51.918352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2671c-aea2-4ed0-a8e5-7645a054025c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:51.923068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707024fa-f742-4b17-89d7-ed3612b91f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:51.923675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707024fa-f742-4b17-89d7-ed3612b91f08 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:51.923956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707024fa-f742-4b17-89d7-ed3612b91f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:51.925571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707024fa-f742-4b17-89d7-ed3612b91f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:51.925571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707024fa-f742-4b17-89d7-ed3612b91f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:51.926543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707024fa-f742-4b17-89d7-ed3612b91f08 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:51.938249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 970/1960] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:51.943227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d456-ee06-446a-ad09-d0128c5dbab7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:51.953396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713d456-ee06-446a-ad09-d0128c5dbab7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:51.958750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9260852-9941-4204-b96a-489079f9498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:51.959399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260852-9941-4204-b96a-489079f9498c admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:51.959677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260852-9941-4204-b96a-489079f9498c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:51.959949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9260852-9941-4204-b96a-489079f9498c admin admin] PATH_INFO: `/v3/projects/74fbbd9ee7a24ab7b0586750ceb18b1c/users/645d6ceda2d64e7fb5d46ed5b1360118/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:51.975442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9260852-9941-4204-b96a-489079f9498c admin admin] RBAC: Authorizing `identity:create_grant(project_id=74fbbd9ee7a24ab7b0586750ceb18b1c, user_id=645d6ceda2d64e7fb5d46ed5b1360118, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:51.978312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9260852-9941-4204-b96a-489079f9498c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:51.991676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 991/1961] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:51 2022] PUT /identity/v3/projects/74fbbd9ee7a24ab7b0586750ceb18b1c/users/645d6ceda2d64e7fb5d46ed5b1360118/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:52.001326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9260852-9941-4204-b96a-489079f9498c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.001865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99941626-ee20-4943-b1c8-d1c2b210b69a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.002301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99941626-ee20-4943-b1c8-d1c2b210b69a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.002418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99941626-ee20-4943-b1c8-d1c2b210b69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.003096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f9260852-9941-4204-b96a-489079f9498c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:52.030726 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-99941626-ee20-4943-b1c8-d1c2b210b69a None None] MFA Rules not processed for user `645d6ceda2d64e7fb5d46ed5b1360118`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:52.032015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-99941626-ee20-4943-b1c8-d1c2b210b69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:52.072540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9260852-9941-4204-b96a-489079f9498c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.077139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.077807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.078088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.078390 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] PATH_INFO: `/v3/users/6db77caf144947368b11b2b08f1e8d79` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.079533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db77caf144947368b11b2b08f1e8d79)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.082028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.100426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 971/1962] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:52.105503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99941626-ee20-4943-b1c8-d1c2b210b69a None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.117046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99941626-ee20-4943-b1c8-d1c2b210b69a None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.122200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b40b1-1452-4e7f-bf89-28033a1ecd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.122849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b40b1-1452-4e7f-bf89-28033a1ecd55 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.123127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b40b1-1452-4e7f-bf89-28033a1ecd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.123441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7b40b1-1452-4e7f-bf89-28033a1ecd55 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.124080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b40b1-1452-4e7f-bf89-28033a1ecd55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.126245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7b40b1-1452-4e7f-bf89-28033a1ecd55 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.130407 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db77caf144947368b11b2b08f1e8d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.132535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:52.137712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db77caf144947368b11b2b08f1e8d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.138481 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db77caf144947368b11b2b08f1e8d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.140672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=83,keystone:DELETE=13,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:52.147952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db77caf144947368b11b2b08f1e8d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.158040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 972/1963] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:52 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:52.162149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b40b1-1452-4e7f-bf89-28033a1ecd55 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.162415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1f786c08-9b18-4249-8281-348ce18a31d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db77caf144947368b11b2b08f1e8d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.163857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8c7b40b1-1452-4e7f-bf89-28033a1ecd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:52.172605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 992/1964] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:52 2022] DELETE /identity/v3/users/6db77caf144947368b11b2b08f1e8d79 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:52.174162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413757-28de-453b-91e8-1eef3086cb6d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.174453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413757-28de-453b-91e8-1eef3086cb6d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.174730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77413757-28de-453b-91e8-1eef3086cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.194961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-77413757-28de-453b-91e8-1eef3086cb6d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:52.196150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-77413757-28de-453b-91e8-1eef3086cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:52.230775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7b40b1-1452-4e7f-bf89-28033a1ecd55 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.259886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 993/1965] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:52.270477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413757-28de-453b-91e8-1eef3086cb6d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.271804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-77413757-28de-453b-91e8-1eef3086cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:52.289009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c481-e409-40b4-93db-f736cd9df1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.289723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c481-e409-40b4-93db-f736cd9df1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.290056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c481-e409-40b4-93db-f736cd9df1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.290340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96c481-e409-40b4-93db-f736cd9df1c3 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.291727 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96c481-e409-40b4-93db-f736cd9df1c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.295756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a96c481-e409-40b4-93db-f736cd9df1c3 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.319692 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 973/1966] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:52 2022] POST /identity/v3/users => generated 299 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:52.323836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c481-e409-40b4-93db-f736cd9df1c3 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.331480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77413757-28de-453b-91e8-1eef3086cb6d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.334134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96c481-e409-40b4-93db-f736cd9df1c3 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.335408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab80716-77a1-4f38-8d58-13c9c05b680a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.336083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80716-77a1-4f38-8d58-13c9c05b680a service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.336301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80716-77a1-4f38-8d58-13c9c05b680a service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.336569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab80716-77a1-4f38-8d58-13c9c05b680a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.343174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eb5de-ec40-4823-a5ea-2d3ea99ec0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.343806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eb5de-ec40-4823-a5ea-2d3ea99ec0c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.344086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eb5de-ec40-4823-a5ea-2d3ea99ec0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.344364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7eb5de-ec40-4823-a5ea-2d3ea99ec0c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.345047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7eb5de-ec40-4823-a5ea-2d3ea99ec0c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.346755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7eb5de-ec40-4823-a5ea-2d3ea99ec0c7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.348002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab80716-77a1-4f38-8d58-13c9c05b680a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.349634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab80716-77a1-4f38-8d58-13c9c05b680a service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.358069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 974/1967] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:52.359425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 994/1968] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:49:52.362279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eb5de-ec40-4823-a5ea-2d3ea99ec0c7 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.372561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7eb5de-ec40-4823-a5ea-2d3ea99ec0c7 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.377511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b888b5-b76b-4cde-827c-c66976a7df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.378185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b888b5-b76b-4cde-827c-c66976a7df36 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.379431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b888b5-b76b-4cde-827c-c66976a7df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.379711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b888b5-b76b-4cde-827c-c66976a7df36 admin admin] PATH_INFO: `/v3/projects/6ee2e1d40bb84c24b5ebdd05fdf0a22c/users/e09ff4aac2704fd8bfd36eed0d98289a/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.397150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b888b5-b76b-4cde-827c-c66976a7df36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee2e1d40bb84c24b5ebdd05fdf0a22c, user_id=e09ff4aac2704fd8bfd36eed0d98289a, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.400180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b888b5-b76b-4cde-827c-c66976a7df36 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.413319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 975/1969] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:52 2022] PUT /identity/v3/projects/6ee2e1d40bb84c24b5ebdd05fdf0a22c/users/e09ff4aac2704fd8bfd36eed0d98289a/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:52.418739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab80716-77a1-4f38-8d58-13c9c05b680a service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.430289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab80716-77a1-4f38-8d58-13c9c05b680a service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.493168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edae62c-8d10-4a1b-9dfb-98dac83a31ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.493806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae62c-8d10-4a1b-9dfb-98dac83a31ff admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.494083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae62c-8d10-4a1b-9dfb-98dac83a31ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.494350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edae62c-8d10-4a1b-9dfb-98dac83a31ff admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.494993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edae62c-8d10-4a1b-9dfb-98dac83a31ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.496573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edae62c-8d10-4a1b-9dfb-98dac83a31ff admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.507093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 995/1970] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:52 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:52.511204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b888b5-b76b-4cde-827c-c66976a7df36 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.522151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b888b5-b76b-4cde-827c-c66976a7df36 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.531503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e07b70-2120-45e7-848d-65d5167f49a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.532147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e07b70-2120-45e7-848d-65d5167f49a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.532457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e07b70-2120-45e7-848d-65d5167f49a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.532925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e07b70-2120-45e7-848d-65d5167f49a6 admin admin] PATH_INFO: `/v3/projects/6ee2e1d40bb84c24b5ebdd05fdf0a22c/users/e09ff4aac2704fd8bfd36eed0d98289a/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.535585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e07b70-2120-45e7-848d-65d5167f49a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ee2e1d40bb84c24b5ebdd05fdf0a22c, user_id=e09ff4aac2704fd8bfd36eed0d98289a, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.538513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e07b70-2120-45e7-848d-65d5167f49a6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.550467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 976/1971] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:52 2022] PUT /identity/v3/projects/6ee2e1d40bb84c24b5ebdd05fdf0a22c/users/e09ff4aac2704fd8bfd36eed0d98289a/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:52.560422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aa58b-5d8a-41d7-a5b9-a26e2b00f7be None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.560855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aa58b-5d8a-41d7-a5b9-a26e2b00f7be None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.561198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3aa58b-5d8a-41d7-a5b9-a26e2b00f7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.588743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:52.592270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2d3aa58b-5d8a-41d7-a5b9-a26e2b00f7be None None] MFA Rules not processed for user `e09ff4aac2704fd8bfd36eed0d98289a`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:52.594800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2d3aa58b-5d8a-41d7-a5b9-a26e2b00f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:52.640998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e07b70-2120-45e7-848d-65d5167f49a6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.642949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f2e07b70-2120-45e7-848d-65d5167f49a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:52.683261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 996/1972] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:52.694065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:52.695072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aa58b-5d8a-41d7-a5b9-a26e2b00f7be None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.697120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2d3aa58b-5d8a-41d7-a5b9-a26e2b00f7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:52.721568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e07b70-2120-45e7-848d-65d5167f49a6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.726892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.727536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.727826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.728087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] PATH_INFO: `/v3/projects/90b79c7010b048f880e336ab4fed59f1` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.729208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b79c7010b048f880e336ab4fed59f1)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.731164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.768286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3aa58b-5d8a-41d7-a5b9-a26e2b00f7be None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.774087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092f229-9dd3-4b13-8eb6-d4ea0388fda8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.775232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092f229-9dd3-4b13-8eb6-d4ea0388fda8 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.775946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092f229-9dd3-4b13-8eb6-d4ea0388fda8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.776537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f092f229-9dd3-4b13-8eb6-d4ea0388fda8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.798234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092f229-9dd3-4b13-8eb6-d4ea0388fda8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.799567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b79c7010b048f880e336ab4fed59f1', 'request_id': 'req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.799703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f092f229-9dd3-4b13-8eb6-d4ea0388fda8 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:52.814879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b79c7010b048f880e336ab4fed59f1', 'request_id': 'req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.822365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 997/1973] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:52.824514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b79c7010b048f880e336ab4fed59f1', 'request_id': 'req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.839179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] The token cache is being invalidate because project 90b79c7010b048f880e336ab4fed59f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:52.839492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.840422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:52.844771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 977/1974] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:52 2022] DELETE /identity/v3/projects/90b79c7010b048f880e336ab4fed59f1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:52.854516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092f229-9dd3-4b13-8eb6-d4ea0388fda8 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.870700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f092f229-9dd3-4b13-8eb6-d4ea0388fda8 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:52.941729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:52.943200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:52.981646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:52.982303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:52.982597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:52.982992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] PATH_INFO: `/v3/users/c740d97f36814561a89a42e2c35f1466` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:52.989615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c740d97f36814561a89a42e2c35f1466)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:52.991700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:53.059455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:53.064109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c740d97f36814561a89a42e2c35f1466'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.072849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af59d1b8-6646-4c48-a9f7-2f1b8911e6c2 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:53.078409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c740d97f36814561a89a42e2c35f1466'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.079478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c740d97f36814561a89a42e2c35f1466'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.084226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:53.085596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.086027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.086447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] PATH_INFO: `/v3/users/645d6ceda2d64e7fb5d46ed5b1360118` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.088525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=645d6ceda2d64e7fb5d46ed5b1360118)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:53.090972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:53.092061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c740d97f36814561a89a42e2c35f1466'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.112296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-865d0ac2-6afb-4ede-b096-44a47bab9e4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c740d97f36814561a89a42e2c35f1466'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.126581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 998/1975] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:52 2022] DELETE /identity/v3/users/c740d97f36814561a89a42e2c35f1466 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:53.172498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '645d6ceda2d64e7fb5d46ed5b1360118'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.184016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '645d6ceda2d64e7fb5d46ed5b1360118'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.184909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '645d6ceda2d64e7fb5d46ed5b1360118'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.203430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:53.205248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '645d6ceda2d64e7fb5d46ed5b1360118'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.223385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '645d6ceda2d64e7fb5d46ed5b1360118'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.252572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 978/1976] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:52 2022] DELETE /identity/v3/users/645d6ceda2d64e7fb5d46ed5b1360118 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:53.257591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b1757-6156-4d45-9377-b8edb56dd615 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.257905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b1757-6156-4d45-9377-b8edb56dd615 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.258164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b1757-6156-4d45-9377-b8edb56dd615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.289032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-255b1757-6156-4d45-9377-b8edb56dd615 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:53.290536 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-255b1757-6156-4d45-9377-b8edb56dd615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:53.358877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:53.360365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:53.363401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 999/1977] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:53.373701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b1757-6156-4d45-9377-b8edb56dd615 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:53.375065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-255b1757-6156-4d45-9377-b8edb56dd615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:53.430582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e14a0fe-9e56-466b-bb4e-9643a21bf35c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:53.434682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d0885-f023-4d1f-b7d9-53d32299b1c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:53.435033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d0885-f023-4d1f-b7d9-53d32299b1c7 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.435380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d0885-f023-4d1f-b7d9-53d32299b1c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.435723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d0885-f023-4d1f-b7d9-53d32299b1c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.437840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-875d0885-f023-4d1f-b7d9-53d32299b1c7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:53.458444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b1757-6156-4d45-9377-b8edb56dd615 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:53.464040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54ccfe-a037-4703-944d-2fe8fb4eb946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:53.464858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54ccfe-a037-4703-944d-2fe8fb4eb946 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.465172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54ccfe-a037-4703-944d-2fe8fb4eb946 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.465524 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc54ccfe-a037-4703-944d-2fe8fb4eb946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.476433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54ccfe-a037-4703-944d-2fe8fb4eb946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:53.478000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc54ccfe-a037-4703-944d-2fe8fb4eb946 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:53.493362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1000/1978] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:49:53.493609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54ccfe-a037-4703-944d-2fe8fb4eb946 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:53.494925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-cc54ccfe-a037-4703-944d-2fe8fb4eb946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:53.511498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc54ccfe-a037-4703-944d-2fe8fb4eb946 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:53.521740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:53.522705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.522926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.523201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] PATH_INFO: `/v3/projects/eff246e7401c4d249bbf4730142082c2` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.524778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] RBAC: Authorizing `identity:delete_project(project_id=eff246e7401c4d249bbf4730142082c2)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:53.527079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:53.529638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d0885-f023-4d1f-b7d9-53d32299b1c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:53.531131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d0885-f023-4d1f-b7d9-53d32299b1c7 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:53.542823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 979/1979] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:49:53.595386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eff246e7401c4d249bbf4730142082c2', 'request_id': 'req-03e0edfa-7754-4142-b827-ac3a8695774a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.610307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eff246e7401c4d249bbf4730142082c2', 'request_id': 'req-03e0edfa-7754-4142-b827-ac3a8695774a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.613343 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:53.618722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eff246e7401c4d249bbf4730142082c2', 'request_id': 'req-03e0edfa-7754-4142-b827-ac3a8695774a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.635291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] The token cache is being invalidate because project eff246e7401c4d249bbf4730142082c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:53.635674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.636883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-03e0edfa-7754-4142-b827-ac3a8695774a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.638775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1001/1980] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:53 2022] DELETE /identity/v3/projects/eff246e7401c4d249bbf4730142082c2 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:53.646013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26fb16-b403-4c51-a97e-b962391a83fb None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.646488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26fb16-b403-4c51-a97e-b962391a83fb None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.646866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26fb16-b403-4c51-a97e-b962391a83fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.699118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-4b26fb16-b403-4c51-a97e-b962391a83fb None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:53.700962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4b26fb16-b403-4c51-a97e-b962391a83fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:53.778332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 980/1981] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:53.786876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb72b1-5a37-483a-9c4c-3d17ce492184 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.787232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb72b1-5a37-483a-9c4c-3d17ce492184 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.787510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbb72b1-5a37-483a-9c4c-3d17ce492184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.807993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-fdbb72b1-5a37-483a-9c4c-3d17ce492184 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:53.809210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fdbb72b1-5a37-483a-9c4c-3d17ce492184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:53.818198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1002/1982] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:53.822514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26fb16-b403-4c51-a97e-b962391a83fb None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:53.833159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26fb16-b403-4c51-a97e-b962391a83fb None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:53.835809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb72b1-5a37-483a-9c4c-3d17ce492184 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:53.837691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fdbb72b1-5a37-483a-9c4c-3d17ce492184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:53.841532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276c1e0-b9ae-48bc-86c6-b5e00ea2a37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:53.842261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276c1e0-b9ae-48bc-86c6-b5e00ea2a37e admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.842568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276c1e0-b9ae-48bc-86c6-b5e00ea2a37e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.842889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276c1e0-b9ae-48bc-86c6-b5e00ea2a37e admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.843613 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276c1e0-b9ae-48bc-86c6-b5e00ea2a37e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:53.843936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276c1e0-b9ae-48bc-86c6-b5e00ea2a37e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:53.845909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276c1e0-b9ae-48bc-86c6-b5e00ea2a37e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:53.852345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbb72b1-5a37-483a-9c4c-3d17ce492184 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:53.859628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:53.860669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.860669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.860950 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 981/1983] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:53.861153 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] PATH_INFO: `/v3/projects/74fbbd9ee7a24ab7b0586750ceb18b1c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.866319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74fbbd9ee7a24ab7b0586750ceb18b1c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:53.866586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276c1e0-b9ae-48bc-86c6-b5e00ea2a37e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:53.868439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:53.877308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276c1e0-b9ae-48bc-86c6-b5e00ea2a37e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:53.882816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a863d-50af-4790-ae4a-f7b1ab3dabd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:53.883459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a863d-50af-4790-ae4a-f7b1ab3dabd8 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:53.883814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a863d-50af-4790-ae4a-f7b1ab3dabd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:53.884105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a863d-50af-4790-ae4a-f7b1ab3dabd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:53.884838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a863d-50af-4790-ae4a-f7b1ab3dabd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:53.886819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667a863d-50af-4790-ae4a-f7b1ab3dabd8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:53.909465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:53.920744 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 982/1984] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:53 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:53.922338 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a863d-50af-4790-ae4a-f7b1ab3dabd8 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:53.924581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74fbbd9ee7a24ab7b0586750ceb18b1c', 'request_id': 'req-08928677-a560-459a-ae63-8d17e161fb01'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.931776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74fbbd9ee7a24ab7b0586750ceb18b1c', 'request_id': 'req-08928677-a560-459a-ae63-8d17e161fb01'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.937642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74fbbd9ee7a24ab7b0586750ceb18b1c', 'request_id': 'req-08928677-a560-459a-ae63-8d17e161fb01'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.953264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] The token cache is being invalidate because project 74fbbd9ee7a24ab7b0586750ceb18b1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:53.953588 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.954265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:53.955793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1003/1985] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:53 2022] DELETE /identity/v3/projects/74fbbd9ee7a24ab7b0586750ceb18b1c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:53.960485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:53.962170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:53.996627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a863d-50af-4790-ae4a-f7b1ab3dabd8 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.002038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4a55-edb0-4395-b6b1-f5d792b0a188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.002735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4a55-edb0-4395-b6b1-f5d792b0a188 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.003027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4a55-edb0-4395-b6b1-f5d792b0a188 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.003439 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecc4a55-edb0-4395-b6b1-f5d792b0a188 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.004158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc4a55-edb0-4395-b6b1-f5d792b0a188 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.006223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecc4a55-edb0-4395-b6b1-f5d792b0a188 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.035292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 983/1986] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:53 2022] POST /identity/v3/users => generated 286 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:54.039257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4a55-edb0-4395-b6b1-f5d792b0a188 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.041021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2ecc4a55-edb0-4395-b6b1-f5d792b0a188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:54.046297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08928677-a560-459a-ae63-8d17e161fb01 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.051976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.052810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.053264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.053600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] PATH_INFO: `/v3/users/e09ff4aac2704fd8bfd36eed0d98289a` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.054878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09ff4aac2704fd8bfd36eed0d98289a)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.055104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecc4a55-edb0-4395-b6b1-f5d792b0a188 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.056896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.060039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39455b8e-9636-4c1d-adc1-cca54e2c4bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.060751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39455b8e-9636-4c1d-adc1-cca54e2c4bca admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.061042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39455b8e-9636-4c1d-adc1-cca54e2c4bca admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.061313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39455b8e-9636-4c1d-adc1-cca54e2c4bca admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.061980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39455b8e-9636-4c1d-adc1-cca54e2c4bca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.063574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39455b8e-9636-4c1d-adc1-cca54e2c4bca admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.076517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 984/1987] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:54.080937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39455b8e-9636-4c1d-adc1-cca54e2c4bca admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.091463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39455b8e-9636-4c1d-adc1-cca54e2c4bca admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.097825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e21c19-3e99-4292-b284-d0ed4405bd70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.098584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e21c19-3e99-4292-b284-d0ed4405bd70 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.098861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e21c19-3e99-4292-b284-d0ed4405bd70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.099152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e21c19-3e99-4292-b284-d0ed4405bd70 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.099810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e21c19-3e99-4292-b284-d0ed4405bd70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.101736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e21c19-3e99-4292-b284-d0ed4405bd70 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.119489 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 985/1988] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:54 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:54.123658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e21c19-3e99-4292-b284-d0ed4405bd70 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.129756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09ff4aac2704fd8bfd36eed0d98289a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.134051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e21c19-3e99-4292-b284-d0ed4405bd70 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.137958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09ff4aac2704fd8bfd36eed0d98289a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.138657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09ff4aac2704fd8bfd36eed0d98289a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.139093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039b1283-9e0d-4f21-93db-ab94a6251556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.139738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1283-9e0d-4f21-93db-ab94a6251556 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.140016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1283-9e0d-4f21-93db-ab94a6251556 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.140294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039b1283-9e0d-4f21-93db-ab94a6251556 admin admin] PATH_INFO: `/v3/projects/1401f94856c64cc7ab6977468231146c/users/b2e634723a3b4bf894a19c9ab6fb3df3/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.150680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09ff4aac2704fd8bfd36eed0d98289a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.153578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:54.156552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1283-9e0d-4f21-93db-ab94a6251556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1401f94856c64cc7ab6977468231146c, user_id=b2e634723a3b4bf894a19c9ab6fb3df3, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.159398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039b1283-9e0d-4f21-93db-ab94a6251556 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.174693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09ff4aac2704fd8bfd36eed0d98289a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.175512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 986/1989] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:54 2022] PUT /identity/v3/projects/1401f94856c64cc7ab6977468231146c/users/b2e634723a3b4bf894a19c9ab6fb3df3/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:54.182527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1004/1990] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:53 2022] DELETE /identity/v3/users/e09ff4aac2704fd8bfd36eed0d98289a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:54.186182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360d777-daa2-45c6-b480-c86003633349 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.186511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360d777-daa2-45c6-b480-c86003633349 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.186787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6360d777-daa2-45c6-b480-c86003633349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.223778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-6360d777-daa2-45c6-b480-c86003633349 None None] MFA Rules not processed for user `b2e634723a3b4bf894a19c9ab6fb3df3`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:54.224995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-6360d777-daa2-45c6-b480-c86003633349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:54.339209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 987/1991] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:54.356237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.357787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:54.472336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b35072-4d94-40ac-85e5-c7a5964d46c0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.477583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b28467-598e-49ab-ae2e-587bb30658c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.478198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b28467-598e-49ab-ae2e-587bb30658c1 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.478476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b28467-598e-49ab-ae2e-587bb30658c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.478746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b28467-598e-49ab-ae2e-587bb30658c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.488703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b28467-598e-49ab-ae2e-587bb30658c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.490439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b28467-598e-49ab-ae2e-587bb30658c1 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.505721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1005/1992] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:54 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:54.525787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360d777-daa2-45c6-b480-c86003633349 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.527568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-6360d777-daa2-45c6-b480-c86003633349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:54.547246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b28467-598e-49ab-ae2e-587bb30658c1 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.549059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-28b28467-598e-49ab-ae2e-587bb30658c1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:54.600987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:54.631219 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b28467-598e-49ab-ae2e-587bb30658c1 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.635947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.636580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.636857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.637128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] PATH_INFO: `/v3/projects/6ee2e1d40bb84c24b5ebdd05fdf0a22c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.638367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ee2e1d40bb84c24b5ebdd05fdf0a22c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.640301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.647177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6360d777-daa2-45c6-b480-c86003633349 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.652934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.652934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.653211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.653491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] PATH_INFO: `/v3/users/b2e634723a3b4bf894a19c9ab6fb3df3` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.654691 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2e634723a3b4bf894a19c9ab6fb3df3)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.656948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.703953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ee2e1d40bb84c24b5ebdd05fdf0a22c', 'request_id': 'req-5b60ff98-8431-464e-939a-7729c4f14704'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.713080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ee2e1d40bb84c24b5ebdd05fdf0a22c', 'request_id': 'req-5b60ff98-8431-464e-939a-7729c4f14704'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.717548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2e634723a3b4bf894a19c9ab6fb3df3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.720180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ee2e1d40bb84c24b5ebdd05fdf0a22c', 'request_id': 'req-5b60ff98-8431-464e-939a-7729c4f14704'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.726055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2e634723a3b4bf894a19c9ab6fb3df3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.726675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2e634723a3b4bf894a19c9ab6fb3df3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.733813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] The token cache is being invalidate because project 6ee2e1d40bb84c24b5ebdd05fdf0a22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:54.734251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.734905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5b60ff98-8431-464e-939a-7729c4f14704 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.736412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1006/1993] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:54 2022] DELETE /identity/v3/projects/6ee2e1d40bb84c24b5ebdd05fdf0a22c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:54.739043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2e634723a3b4bf894a19c9ab6fb3df3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.741613 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96574-74b2-4ee8-98e1-2e5e7166947c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.742050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96574-74b2-4ee8-98e1-2e5e7166947c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.742346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b96574-74b2-4ee8-98e1-2e5e7166947c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.746264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ef59e258-164a-4b88-b3fe-9748d139a87b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2e634723a3b4bf894a19c9ab6fb3df3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:54.752209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 988/1994] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:54 2022] DELETE /identity/v3/users/b2e634723a3b4bf894a19c9ab6fb3df3 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:54.756619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263225dd-87e3-440b-9063-2880573d867e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.756897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263225dd-87e3-440b-9063-2880573d867e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.757195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263225dd-87e3-440b-9063-2880573d867e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.770339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a7b96574-74b2-4ee8-98e1-2e5e7166947c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:54.771809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a7b96574-74b2-4ee8-98e1-2e5e7166947c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:54.776643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-263225dd-87e3-440b-9063-2880573d867e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:54.777832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-263225dd-87e3-440b-9063-2880573d867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:54.782020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:54.837996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1007/1995] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:54.846656 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 989/1996] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:54.848746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f781-2aca-4a03-8b1b-5fc35de8395a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.849034 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f781-2aca-4a03-8b1b-5fc35de8395a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.849306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927f781-2aca-4a03-8b1b-5fc35de8395a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.852441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263225dd-87e3-440b-9063-2880573d867e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.854027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-263225dd-87e3-440b-9063-2880573d867e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:54.869031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b927f781-2aca-4a03-8b1b-5fc35de8395a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:54.870227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b927f781-2aca-4a03-8b1b-5fc35de8395a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:54.882065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1008/1997] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:54.883118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927f781-2aca-4a03-8b1b-5fc35de8395a None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.896293 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b927f781-2aca-4a03-8b1b-5fc35de8395a None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.901018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f24b1-0be2-44ef-9c26-8e465437a254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.901650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f24b1-0be2-44ef-9c26-8e465437a254 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.901932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f24b1-0be2-44ef-9c26-8e465437a254 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.902205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f24b1-0be2-44ef-9c26-8e465437a254 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.902844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f24b1-0be2-44ef-9c26-8e465437a254 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:54.903175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f24b1-0be2-44ef-9c26-8e465437a254 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.904769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f24b1-0be2-44ef-9c26-8e465437a254 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.910924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263225dd-87e3-440b-9063-2880573d867e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.914630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf324d-8ae0-4910-ba84-a7dd928542f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.915241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf324d-8ae0-4910-ba84-a7dd928542f3 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.915523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf324d-8ae0-4910-ba84-a7dd928542f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.915798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf324d-8ae0-4910-ba84-a7dd928542f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.920641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1009/1998] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:49:54.921734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f24b1-0be2-44ef-9c26-8e465437a254 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.922849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:54.925504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf324d-8ae0-4910-ba84-a7dd928542f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.927350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcf324d-8ae0-4910-ba84-a7dd928542f3 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.932734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f24b1-0be2-44ef-9c26-8e465437a254 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:54.940429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 990/1999] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:54.942765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc1d8c-571a-497f-bcdb-3ce150f3c587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:54.943381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc1d8c-571a-497f-bcdb-3ce150f3c587 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:54.943658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc1d8c-571a-497f-bcdb-3ce150f3c587 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:54.943924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abc1d8c-571a-497f-bcdb-3ce150f3c587 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:54.944560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc1d8c-571a-497f-bcdb-3ce150f3c587 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:54.946497 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abc1d8c-571a-497f-bcdb-3ce150f3c587 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:54.975866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1010/2000] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:54 2022] POST /identity/v3/projects => generated 387 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:54.980357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf324d-8ae0-4910-ba84-a7dd928542f3 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:54.990163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf324d-8ae0-4910-ba84-a7dd928542f3 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.053609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774a39-4201-4019-b49e-332811c7ea46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.054414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774a39-4201-4019-b49e-332811c7ea46 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.054843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774a39-4201-4019-b49e-332811c7ea46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.055115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa774a39-4201-4019-b49e-332811c7ea46 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.055747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774a39-4201-4019-b49e-332811c7ea46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.057684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa774a39-4201-4019-b49e-332811c7ea46 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.086169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 991/2001] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:54 2022] POST /identity/v3/users => generated 294 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:55.088299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc1d8c-571a-497f-bcdb-3ce150f3c587 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.101700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abc1d8c-571a-497f-bcdb-3ce150f3c587 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.107091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18a0c2-32ef-43be-9216-10beac64e589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.108024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18a0c2-32ef-43be-9216-10beac64e589 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.108024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18a0c2-32ef-43be-9216-10beac64e589 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.108259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18a0c2-32ef-43be-9216-10beac64e589 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.108903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18a0c2-32ef-43be-9216-10beac64e589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.110521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18a0c2-32ef-43be-9216-10beac64e589 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.121666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1011/2002] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:55.125804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774a39-4201-4019-b49e-332811c7ea46 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.137626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa774a39-4201-4019-b49e-332811c7ea46 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.142114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a9d15-a92f-47ef-ad40-e4de9e24b3d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.142728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a9d15-a92f-47ef-ad40-e4de9e24b3d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.143008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a9d15-a92f-47ef-ad40-e4de9e24b3d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.143281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a9d15-a92f-47ef-ad40-e4de9e24b3d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.143956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a9d15-a92f-47ef-ad40-e4de9e24b3d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.145736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a9d15-a92f-47ef-ad40-e4de9e24b3d1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.156099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 992/2003] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:55.160832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18a0c2-32ef-43be-9216-10beac64e589 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.170764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18a0c2-32ef-43be-9216-10beac64e589 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.176082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d862d4b-b56d-4450-983e-1480d4a614db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.176733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d862d4b-b56d-4450-983e-1480d4a614db admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.177008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d862d4b-b56d-4450-983e-1480d4a614db admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.177275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d862d4b-b56d-4450-983e-1480d4a614db admin admin] PATH_INFO: `/v3/projects/dd1d6b10e5744e3aaeedddae155ca31e/users/0e0ad2e5a21249b5a137a68afaa1b1e1/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.192793 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d862d4b-b56d-4450-983e-1480d4a614db admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1d6b10e5744e3aaeedddae155ca31e, user_id=0e0ad2e5a21249b5a137a68afaa1b1e1, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.195474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d862d4b-b56d-4450-983e-1480d4a614db admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.210201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1012/2004] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:55 2022] PUT /identity/v3/projects/dd1d6b10e5744e3aaeedddae155ca31e/users/0e0ad2e5a21249b5a137a68afaa1b1e1/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:55.222631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547847e2-2def-4c08-a124-736a9938ccc8 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.222631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547847e2-2def-4c08-a124-736a9938ccc8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.222631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547847e2-2def-4c08-a124-736a9938ccc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.223684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d862d4b-b56d-4450-983e-1480d4a614db admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.225979 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2d862d4b-b56d-4450-983e-1480d4a614db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:55.251806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-547847e2-2def-4c08-a124-736a9938ccc8 None None] MFA Rules not processed for user `0e0ad2e5a21249b5a137a68afaa1b1e1`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:55.253077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-547847e2-2def-4c08-a124-736a9938ccc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:55.300870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d862d4b-b56d-4450-983e-1480d4a614db admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.305681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.306324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.306606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.306885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] PATH_INFO: `/v3/projects/1401f94856c64cc7ab6977468231146c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.308041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1401f94856c64cc7ab6977468231146c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.309983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.322520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 993/2005] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:55.326917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547847e2-2def-4c08-a124-736a9938ccc8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.337677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547847e2-2def-4c08-a124-736a9938ccc8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.342594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b863ba9-2bb1-4013-95ef-1d25ad059567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.343195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b863ba9-2bb1-4013-95ef-1d25ad059567 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.343476 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b863ba9-2bb1-4013-95ef-1d25ad059567 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.343749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b863ba9-2bb1-4013-95ef-1d25ad059567 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.344376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b863ba9-2bb1-4013-95ef-1d25ad059567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.346357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b863ba9-2bb1-4013-95ef-1d25ad059567 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.352852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:55.361752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1401f94856c64cc7ab6977468231146c', 'request_id': 'req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:55.370252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1401f94856c64cc7ab6977468231146c', 'request_id': 'req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:55.376241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1401f94856c64cc7ab6977468231146c', 'request_id': 'req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:55.378595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 994/2006] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:55 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:55.382278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b863ba9-2bb1-4013-95ef-1d25ad059567 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.387886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] The token cache is being invalidate because project 1401f94856c64cc7ab6977468231146c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:55.388113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:55.388792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-a21fe3fb-1cdf-42eb-86aa-72ad316197c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:55.390326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1013/2007] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:55 2022] DELETE /identity/v3/projects/1401f94856c64cc7ab6977468231146c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:55.396342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dfbc2-206f-4acc-8ce4-e36fc7cfcb07 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.396653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dfbc2-206f-4acc-8ce4-e36fc7cfcb07 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.396928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dfbc2-206f-4acc-8ce4-e36fc7cfcb07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.417759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-560dfbc2-206f-4acc-8ce4-e36fc7cfcb07 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:55.418965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-560dfbc2-206f-4acc-8ce4-e36fc7cfcb07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:55.428653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:55.447700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b863ba9-2bb1-4013-95ef-1d25ad059567 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.452359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebe681-6049-45ee-a23c-eb5e9cc27272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.452962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebe681-6049-45ee-a23c-eb5e9cc27272 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.453238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebe681-6049-45ee-a23c-eb5e9cc27272 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.453542 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ebe681-6049-45ee-a23c-eb5e9cc27272 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.454166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebe681-6049-45ee-a23c-eb5e9cc27272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.456076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ebe681-6049-45ee-a23c-eb5e9cc27272 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.480267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 995/2008] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:55 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:55.484098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebe681-6049-45ee-a23c-eb5e9cc27272 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.486294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-62ebe681-6049-45ee-a23c-eb5e9cc27272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:55.495595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1014/2009] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:55.498470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ebe681-6049-45ee-a23c-eb5e9cc27272 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.503185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a9eea-45d6-4ca8-b377-bbe43d8c4b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.503795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a9eea-45d6-4ca8-b377-bbe43d8c4b2d admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.504076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a9eea-45d6-4ca8-b377-bbe43d8c4b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.504351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786a9eea-45d6-4ca8-b377-bbe43d8c4b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.504993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a9eea-45d6-4ca8-b377-bbe43d8c4b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.505317 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11c51-7f47-4474-b290-fd1dfb9b2efd None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.505654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11c51-7f47-4474-b290-fd1dfb9b2efd None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.505935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb11c51-7f47-4474-b290-fd1dfb9b2efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.506625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786a9eea-45d6-4ca8-b377-bbe43d8c4b2d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.519386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 996/2010] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:55.523356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a9eea-45d6-4ca8-b377-bbe43d8c4b2d admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.528567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3bb11c51-7f47-4474-b290-fd1dfb9b2efd None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:55.529864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3bb11c51-7f47-4474-b290-fd1dfb9b2efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:55.537274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786a9eea-45d6-4ca8-b377-bbe43d8c4b2d admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.538910 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1015/2011] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:55.539864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3307af4-abb4-4f9d-8bcb-5902a7773a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.540534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3307af4-abb4-4f9d-8bcb-5902a7773a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.540818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3307af4-abb4-4f9d-8bcb-5902a7773a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.541099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3307af4-abb4-4f9d-8bcb-5902a7773a0c admin admin] PATH_INFO: `/v3/projects/33785130fe75424d8695c21ed888a6c6/users/0590e34b40f14e489e7b8926489f2640/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.543055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11c51-7f47-4474-b290-fd1dfb9b2efd None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.553282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb11c51-7f47-4474-b290-fd1dfb9b2efd None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.559238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02664f-a49a-4183-a7f4-6f10c0bd5d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.559869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02664f-a49a-4183-a7f4-6f10c0bd5d26 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.560152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02664f-a49a-4183-a7f4-6f10c0bd5d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.560434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02664f-a49a-4183-a7f4-6f10c0bd5d26 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.561103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02664f-a49a-4183-a7f4-6f10c0bd5d26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:55.561475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02664f-a49a-4183-a7f4-6f10c0bd5d26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.563199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa02664f-a49a-4183-a7f4-6f10c0bd5d26 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.564321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3307af4-abb4-4f9d-8bcb-5902a7773a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=33785130fe75424d8695c21ed888a6c6, user_id=0590e34b40f14e489e7b8926489f2640, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.566490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3307af4-abb4-4f9d-8bcb-5902a7773a0c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.577281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1016/2012] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:49:55.582776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02664f-a49a-4183-a7f4-6f10c0bd5d26 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.589485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 997/2013] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:55 2022] PUT /identity/v3/projects/33785130fe75424d8695c21ed888a6c6/users/0590e34b40f14e489e7b8926489f2640/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:55.591257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3307af4-abb4-4f9d-8bcb-5902a7773a0c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.593752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02664f-a49a-4183-a7f4-6f10c0bd5d26 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.672059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3307af4-abb4-4f9d-8bcb-5902a7773a0c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.677085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b764c-7f5c-48b7-ba52-1fd384737c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.677824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b764c-7f5c-48b7-ba52-1fd384737c26 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.678102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b764c-7f5c-48b7-ba52-1fd384737c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.678220 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e3c58-e5bc-4cb7-b52a-9fb7457a3238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.678377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0b764c-7f5c-48b7-ba52-1fd384737c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.678869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e3c58-e5bc-4cb7-b52a-9fb7457a3238 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.679019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b764c-7f5c-48b7-ba52-1fd384737c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.679217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e3c58-e5bc-4cb7-b52a-9fb7457a3238 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.679495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352e3c58-e5bc-4cb7-b52a-9fb7457a3238 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.680159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e3c58-e5bc-4cb7-b52a-9fb7457a3238 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.680735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0b764c-7f5c-48b7-ba52-1fd384737c26 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.682105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352e3c58-e5bc-4cb7-b52a-9fb7457a3238 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.691543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 998/2014] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:55.695504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b764c-7f5c-48b7-ba52-1fd384737c26 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.708034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0b764c-7f5c-48b7-ba52-1fd384737c26 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.713317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786ec400-34c5-4ce9-b220-0b743c389414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.717082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ec400-34c5-4ce9-b220-0b743c389414 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.717215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1017/2015] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:55 2022] POST /identity/v3/projects => generated 369 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:55.717326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ec400-34c5-4ce9-b220-0b743c389414 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.717326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786ec400-34c5-4ce9-b220-0b743c389414 admin admin] PATH_INFO: `/v3/projects/33785130fe75424d8695c21ed888a6c6/users/0590e34b40f14e489e7b8926489f2640/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.718099 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e3c58-e5bc-4cb7-b52a-9fb7457a3238 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.719013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ec400-34c5-4ce9-b220-0b743c389414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33785130fe75424d8695c21ed888a6c6, user_id=0590e34b40f14e489e7b8926489f2640, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.721929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786ec400-34c5-4ce9-b220-0b743c389414 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.735399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 999/2016] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:55 2022] PUT /identity/v3/projects/33785130fe75424d8695c21ed888a6c6/users/0590e34b40f14e489e7b8926489f2640/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:55.748534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdfdab-6791-4af7-95c5-f0abafd606d0 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.748733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdfdab-6791-4af7-95c5-f0abafd606d0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.749120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcdfdab-6791-4af7-95c5-f0abafd606d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.783724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:55.798554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9dcdfdab-6791-4af7-95c5-f0abafd606d0 None None] MFA Rules not processed for user `0590e34b40f14e489e7b8926489f2640`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:55.800490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9dcdfdab-6791-4af7-95c5-f0abafd606d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:55.822274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352e3c58-e5bc-4cb7-b52a-9fb7457a3238 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.877889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1000/2017] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:55 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:55.881608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250cb15-576e-454c-8e23-000403115c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.882228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250cb15-576e-454c-8e23-000403115c41 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.882512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250cb15-576e-454c-8e23-000403115c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.882791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8250cb15-576e-454c-8e23-000403115c41 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.883426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250cb15-576e-454c-8e23-000403115c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.885378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8250cb15-576e-454c-8e23-000403115c41 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.890355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdfdab-6791-4af7-95c5-f0abafd606d0 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.891702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9dcdfdab-6791-4af7-95c5-f0abafd606d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:55.899111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:55.908850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1018/2018] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:55 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:55.912935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250cb15-576e-454c-8e23-000403115c41 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.922730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8250cb15-576e-454c-8e23-000403115c41 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.927692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480394e-0cc4-475b-a682-1fb5e8c2de03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.928275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480394e-0cc4-475b-a682-1fb5e8c2de03 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.928555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480394e-0cc4-475b-a682-1fb5e8c2de03 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.928831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7480394e-0cc4-475b-a682-1fb5e8c2de03 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.929503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480394e-0cc4-475b-a682-1fb5e8c2de03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.931101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7480394e-0cc4-475b-a682-1fb5e8c2de03 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.944258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1019/2019] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:55.945468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480394e-0cc4-475b-a682-1fb5e8c2de03 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.951966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcdfdab-6791-4af7-95c5-f0abafd606d0 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.954759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7480394e-0cc4-475b-a682-1fb5e8c2de03 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.955693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b875b16b-785f-447a-94f2-896f069fa6ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.956995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875b16b-785f-447a-94f2-896f069fa6ad service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.957239 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875b16b-785f-447a-94f2-896f069fa6ad service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.957539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875b16b-785f-447a-94f2-896f069fa6ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.959853 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f491a5-7fa1-4e06-b5ff-0e7864df2ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.960466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f491a5-7fa1-4e06-b5ff-0e7864df2ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.960748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f491a5-7fa1-4e06-b5ff-0e7864df2ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.961025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f491a5-7fa1-4e06-b5ff-0e7864df2ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:55.961975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f491a5-7fa1-4e06-b5ff-0e7864df2ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.963643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f491a5-7fa1-4e06-b5ff-0e7864df2ff5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.967301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875b16b-785f-447a-94f2-896f069fa6ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:55.968815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b875b16b-785f-447a-94f2-896f069fa6ad service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:55.976908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1020/2020] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:49:55.977895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f491a5-7fa1-4e06-b5ff-0e7864df2ff5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:55.979139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1001/2021] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:49:55.987375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f491a5-7fa1-4e06-b5ff-0e7864df2ff5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:55.992563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf158b-41c5-49fc-888f-c4a1e2caf9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:55.993295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf158b-41c5-49fc-888f-c4a1e2caf9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:55.993672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf158b-41c5-49fc-888f-c4a1e2caf9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:55.994012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf158b-41c5-49fc-888f-c4a1e2caf9b2 admin admin] PATH_INFO: `/v3/projects/55e398625838487eb27257cfe4fbd5f3/users/132e93f8b39d4f2981c4bd97db719f69/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:56.009598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf158b-41c5-49fc-888f-c4a1e2caf9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55e398625838487eb27257cfe4fbd5f3, user_id=132e93f8b39d4f2981c4bd97db719f69, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:56.012311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf158b-41c5-49fc-888f-c4a1e2caf9b2 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:56.025691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1021/2022] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:55 2022] PUT /identity/v3/projects/55e398625838487eb27257cfe4fbd5f3/users/132e93f8b39d4f2981c4bd97db719f69/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:56.035896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a99790-23e4-4e84-9236-e64dfad947ed None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:56.036186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a99790-23e4-4e84-9236-e64dfad947ed None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:56.036467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a99790-23e4-4e84-9236-e64dfad947ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:56.066430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b1a99790-23e4-4e84-9236-e64dfad947ed None None] MFA Rules not processed for user `132e93f8b39d4f2981c4bd97db719f69`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:56.067830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b1a99790-23e4-4e84-9236-e64dfad947ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:56.144227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1002/2023] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:56.155068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf158b-41c5-49fc-888f-c4a1e2caf9b2 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:56.157089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4dbf158b-41c5-49fc-888f-c4a1e2caf9b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:56.242485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf158b-41c5-49fc-888f-c4a1e2caf9b2 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:56.246857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd27eb-2af8-439c-b32f-da700a918207 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babdd851ad7b4ba99b5746d8480bc082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:56.247501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd27eb-2af8-439c-b32f-da700a918207 service glance] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:56.247782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd27eb-2af8-439c-b32f-da700a918207 service glance] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:56.248561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd27eb-2af8-439c-b32f-da700a918207 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:56.257457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd27eb-2af8-439c-b32f-da700a918207 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:56.258895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd27eb-2af8-439c-b32f-da700a918207 service glance] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:56.268785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1022/2024] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:56 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:49:56.586162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a99790-23e4-4e84-9236-e64dfad947ed None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:56.649452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a99790-23e4-4e84-9236-e64dfad947ed None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:56.654177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:56.654814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:56.655096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:56.655378 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] PATH_INFO: `/v3/users/0e0ad2e5a21249b5a137a68afaa1b1e1` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:56.656560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e0ad2e5a21249b5a137a68afaa1b1e1)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:56.658531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:56.746111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:56.765373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e0ad2e5a21249b5a137a68afaa1b1e1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:56.775854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e0ad2e5a21249b5a137a68afaa1b1e1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:56.776723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e0ad2e5a21249b5a137a68afaa1b1e1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:56.791655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e0ad2e5a21249b5a137a68afaa1b1e1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:56.800403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e0ad2e5a21249b5a137a68afaa1b1e1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:56.813448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1003/2025] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:56 2022] DELETE /identity/v3/users/0e0ad2e5a21249b5a137a68afaa1b1e1 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:56.817095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f16e57-1391-4a53-9c47-81f8ebacca47 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:56.817095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f16e57-1391-4a53-9c47-81f8ebacca47 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:56.817674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f16e57-1391-4a53-9c47-81f8ebacca47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:56.845323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c2f16e57-1391-4a53-9c47-81f8ebacca47 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:56.847818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c2f16e57-1391-4a53-9c47-81f8ebacca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:56.853248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:56.915155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1023/2026] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:56.925253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:56.926763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:56.994664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd124717-2c7f-4d0b-879e-088d72a25495 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:56.998448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59102ac-6fd7-4ce4-b91b-539d4042fd0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:56.999062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59102ac-6fd7-4ce4-b91b-539d4042fd0e service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:56.999340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59102ac-6fd7-4ce4-b91b-539d4042fd0e service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:56.999614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59102ac-6fd7-4ce4-b91b-539d4042fd0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:57.022393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59102ac-6fd7-4ce4-b91b-539d4042fd0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:57.023902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59102ac-6fd7-4ce4-b91b-539d4042fd0e service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:57.035954 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1004/2027] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:49:57.351992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f16e57-1391-4a53-9c47-81f8ebacca47 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:57.357714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c2f16e57-1391-4a53-9c47-81f8ebacca47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:57.371839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f16e57-1391-4a53-9c47-81f8ebacca47 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:57.376675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:57.377359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:57.377672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:57.377947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] PATH_INFO: `/v3/projects/dd1d6b10e5744e3aaeedddae155ca31e` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:57.379721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1d6b10e5744e3aaeedddae155ca31e)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:57.381656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:57.441666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1d6b10e5744e3aaeedddae155ca31e', 'request_id': 'req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.453270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1d6b10e5744e3aaeedddae155ca31e', 'request_id': 'req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.462670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1d6b10e5744e3aaeedddae155ca31e', 'request_id': 'req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.474799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] The token cache is being invalidate because project dd1d6b10e5744e3aaeedddae155ca31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:57.475095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.475762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.477969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1024/2028] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:57 2022] DELETE /identity/v3/projects/dd1d6b10e5744e3aaeedddae155ca31e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:57.482685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59102ac-6fd7-4ce4-b91b-539d4042fd0e service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:57.493567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59102ac-6fd7-4ce4-b91b-539d4042fd0e service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:57.557776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:57.558421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:57.558745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:57.559088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] PATH_INFO: `/v3/users/0590e34b40f14e489e7b8926489f2640` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:57.560252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=0590e34b40f14e489e7b8926489f2640)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:57.562403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:57.609292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0590e34b40f14e489e7b8926489f2640'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.617856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0590e34b40f14e489e7b8926489f2640'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.618595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0590e34b40f14e489e7b8926489f2640'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.624402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:57.634898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0590e34b40f14e489e7b8926489f2640'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.642358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-79c83cc2-9cd6-4826-a3e6-64f65b2ff6ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0590e34b40f14e489e7b8926489f2640'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:57.649074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1005/2029] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:49:57 2022] DELETE /identity/v3/users/0590e34b40f14e489e7b8926489f2640 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:49:57.942179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:57.943781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:57.957792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c3aac5-1237-4244-bc2c-3e4fbb92d9b8 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:58.017936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:58.018580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.018895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.019169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] PATH_INFO: `/v3/projects/33785130fe75424d8695c21ed888a6c6` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.020278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33785130fe75424d8695c21ed888a6c6)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:58.022302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:58.060798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:58.077165 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33785130fe75424d8695c21ed888a6c6', 'request_id': 'req-7756221c-a1de-42fa-9e59-91816b812d96'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:58.084915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33785130fe75424d8695c21ed888a6c6', 'request_id': 'req-7756221c-a1de-42fa-9e59-91816b812d96'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:58.091036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33785130fe75424d8695c21ed888a6c6', 'request_id': 'req-7756221c-a1de-42fa-9e59-91816b812d96'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:58.102568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] The token cache is being invalidate because project 33785130fe75424d8695c21ed888a6c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:49:58.102854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:58.103538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7756221c-a1de-42fa-9e59-91816b812d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:49:58.105094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1025/2030] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:49:57 2022] DELETE /identity/v3/projects/33785130fe75424d8695c21ed888a6c6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:58.109792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ef51-8181-489e-8953-48a1bdfe9511 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.110081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ef51-8181-489e-8953-48a1bdfe9511 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.110384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5617ef51-8181-489e-8953-48a1bdfe9511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.130516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-5617ef51-8181-489e-8953-48a1bdfe9511 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:58.131712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5617ef51-8181-489e-8953-48a1bdfe9511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:58.208114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1006/2031] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:58.216543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c14dd-7a03-4484-855a-d72d1a4dd55e None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.216829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c14dd-7a03-4484-855a-d72d1a4dd55e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.217166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c14dd-7a03-4484-855a-d72d1a4dd55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.249043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e42c14dd-7a03-4484-855a-d72d1a4dd55e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:58.251678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e42c14dd-7a03-4484-855a-d72d1a4dd55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:58.263304 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1026/2032] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:49:58.267441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617ef51-8181-489e-8953-48a1bdfe9511 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:58.278060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5617ef51-8181-489e-8953-48a1bdfe9511 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:58.282797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580edd-0c0b-446d-b2b1-7269a04925af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:58.283423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580edd-0c0b-446d-b2b1-7269a04925af admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.283718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580edd-0c0b-446d-b2b1-7269a04925af admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.284065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18580edd-0c0b-446d-b2b1-7269a04925af admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.289360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580edd-0c0b-446d-b2b1-7269a04925af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:49:58.289360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580edd-0c0b-446d-b2b1-7269a04925af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:58.289360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18580edd-0c0b-446d-b2b1-7269a04925af admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:58.305473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1007/2033] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:49:58.308362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c14dd-7a03-4484-855a-d72d1a4dd55e None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:58.329667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c14dd-7a03-4484-855a-d72d1a4dd55e None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:58.329667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e8220-769a-4f35-994e-db7011b24614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:58.329667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e8220-769a-4f35-994e-db7011b24614 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.329667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e8220-769a-4f35-994e-db7011b24614 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.330071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e8220-769a-4f35-994e-db7011b24614 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.330071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e8220-769a-4f35-994e-db7011b24614 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:58.333522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e8220-769a-4f35-994e-db7011b24614 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:58.369366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1027/2034] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:49:58 2022] POST /identity/v3/projects => generated 377 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:49:58.373655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580edd-0c0b-446d-b2b1-7269a04925af admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:58.385886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18580edd-0c0b-446d-b2b1-7269a04925af admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:58.443995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183b89-66ec-4237-8c91-976c7a30d62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:58.444614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183b89-66ec-4237-8c91-976c7a30d62f admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.444895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183b89-66ec-4237-8c91-976c7a30d62f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.445167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c183b89-66ec-4237-8c91-976c7a30d62f admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.445831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c183b89-66ec-4237-8c91-976c7a30d62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:58.447799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c183b89-66ec-4237-8c91-976c7a30d62f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:58.472914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1008/2035] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:49:58 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:49:58.474215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e8220-769a-4f35-994e-db7011b24614 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:58.484358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e8220-769a-4f35-994e-db7011b24614 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:58.488951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe27a2-7721-49c8-8920-9976cf8bdb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:58.489573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe27a2-7721-49c8-8920-9976cf8bdb7a admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.489853 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe27a2-7721-49c8-8920-9976cf8bdb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.490126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe27a2-7721-49c8-8920-9976cf8bdb7a admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.490763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe27a2-7721-49c8-8920-9976cf8bdb7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:58.492327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe27a2-7721-49c8-8920-9976cf8bdb7a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:58.501943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1028/2036] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:58.506712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183b89-66ec-4237-8c91-976c7a30d62f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:58.517915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c183b89-66ec-4237-8c91-976c7a30d62f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:58.523108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b95d3e-2e8f-4723-b3f0-e450493550f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:58.523717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95d3e-2e8f-4723-b3f0-e450493550f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.524000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95d3e-2e8f-4723-b3f0-e450493550f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.524958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b95d3e-2e8f-4723-b3f0-e450493550f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.524958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b95d3e-2e8f-4723-b3f0-e450493550f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:58.526604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b95d3e-2e8f-4723-b3f0-e450493550f4 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:58.537682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1009/2037] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:49:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:49:58.542047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe27a2-7721-49c8-8920-9976cf8bdb7a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:58.552032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe27a2-7721-49c8-8920-9976cf8bdb7a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:58.557157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637264-7c77-4283-8626-8bb887a1b1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:58.557670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637264-7c77-4283-8626-8bb887a1b1f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.557952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637264-7c77-4283-8626-8bb887a1b1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.558232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12637264-7c77-4283-8626-8bb887a1b1f0 admin admin] PATH_INFO: `/v3/projects/5d920ecc73bf42beb6ada7fe8d033b33/users/b0e321e2b55d40b9b11faf710fde0166/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.572734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12637264-7c77-4283-8626-8bb887a1b1f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d920ecc73bf42beb6ada7fe8d033b33, user_id=b0e321e2b55d40b9b11faf710fde0166, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:58.575428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12637264-7c77-4283-8626-8bb887a1b1f0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:58.589940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1029/2038] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:49:58 2022] PUT /identity/v3/projects/5d920ecc73bf42beb6ada7fe8d033b33/users/b0e321e2b55d40b9b11faf710fde0166/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:49:58.600814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3eaa4-ec27-4e2a-966c-8328b404e63c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.601096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3eaa4-ec27-4e2a-966c-8328b404e63c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.601393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3eaa4-ec27-4e2a-966c-8328b404e63c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.632207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e8f3eaa4-ec27-4e2a-966c-8328b404e63c None None] MFA Rules not processed for user `b0e321e2b55d40b9b11faf710fde0166`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:49:58.633417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e8f3eaa4-ec27-4e2a-966c-8328b404e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:58.668033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:49:58.704435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1010/2039] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:49:58.716570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637264-7c77-4283-8626-8bb887a1b1f0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:49:58.718270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-12637264-7c77-4283-8626-8bb887a1b1f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:49:58.776655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12637264-7c77-4283-8626-8bb887a1b1f0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:49:58.780538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a4908-6877-4df4-b294-7a421a1c849b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:49:58.781140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a4908-6877-4df4-b294-7a421a1c849b service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:49:58.781431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a4908-6877-4df4-b294-7a421a1c849b service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:49:58.781720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a4908-6877-4df4-b294-7a421a1c849b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:49:58.789826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a4908-6877-4df4-b294-7a421a1c849b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:49:58.791230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a4908-6877-4df4-b294-7a421a1c849b service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:49:58.799782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1030/2040] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:49:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:05.101559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3eaa4-ec27-4e2a-966c-8328b404e63c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:05.103058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e8f3eaa4-ec27-4e2a-966c-8328b404e63c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:05.168859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3eaa4-ec27-4e2a-966c-8328b404e63c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:05.173542 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:05.174178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:05.174456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:05.175304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] PATH_INFO: `/v3/users/615f5f4e10234884806f9c6ae834842d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:05.176432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=615f5f4e10234884806f9c6ae834842d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:05.183671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:05.230943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '615f5f4e10234884806f9c6ae834842d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.241022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '615f5f4e10234884806f9c6ae834842d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.241766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '615f5f4e10234884806f9c6ae834842d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.256462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '615f5f4e10234884806f9c6ae834842d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.271947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '615f5f4e10234884806f9c6ae834842d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.279189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1011/2041] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:05 2022] DELETE /identity/v3/users/615f5f4e10234884806f9c6ae834842d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:05.283580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbd241-c4f9-492c-89b0-32d2f2d33db5 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:05.284062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbd241-c4f9-492c-89b0-32d2f2d33db5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:05.284272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcbd241-c4f9-492c-89b0-32d2f2d33db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:05.305840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ddcbd241-c4f9-492c-89b0-32d2f2d33db5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:05.307711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ddcbd241-c4f9-492c-89b0-32d2f2d33db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:05.387108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1031/2042] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:05.397878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:05.399311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:05.473098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62ea94-06bd-45a5-8a5c-6ea884b9d639 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:05.476748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c229f6b3-0a97-41dd-9f18-8c4def7ccdfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:05.477358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229f6b3-0a97-41dd-9f18-8c4def7ccdfa service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:05.477766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229f6b3-0a97-41dd-9f18-8c4def7ccdfa service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:05.478040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c229f6b3-0a97-41dd-9f18-8c4def7ccdfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:05.485303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:05.488682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229f6b3-0a97-41dd-9f18-8c4def7ccdfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:05.491079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c229f6b3-0a97-41dd-9f18-8c4def7ccdfa service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:05.502833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1012/2043] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:05.772662 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbd241-c4f9-492c-89b0-32d2f2d33db5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:05.774117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ddcbd241-c4f9-492c-89b0-32d2f2d33db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:05.782119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:05.791856 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcbd241-c4f9-492c-89b0-32d2f2d33db5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:05.798177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:05.798833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:05.799113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:05.799454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] PATH_INFO: `/v3/projects/c1e4d7edaf9449dd9ac0471807d63cd0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:05.800633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1e4d7edaf9449dd9ac0471807d63cd0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:05.802628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:05.850707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1e4d7edaf9449dd9ac0471807d63cd0', 'request_id': 'req-dd9f6f68-0b50-45fd-9be2-f13a37383669'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.856908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1e4d7edaf9449dd9ac0471807d63cd0', 'request_id': 'req-dd9f6f68-0b50-45fd-9be2-f13a37383669'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.862550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1e4d7edaf9449dd9ac0471807d63cd0', 'request_id': 'req-dd9f6f68-0b50-45fd-9be2-f13a37383669'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.873305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] The token cache is being invalidate because project c1e4d7edaf9449dd9ac0471807d63cd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:05.873622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.874250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-dd9f6f68-0b50-45fd-9be2-f13a37383669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:05.875709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1032/2044] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:05 2022] DELETE /identity/v3/projects/c1e4d7edaf9449dd9ac0471807d63cd0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:50:05.880574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbce98-3d93-4a42-96b9-9187fcbc1ce7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:05.881263 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbce98-3d93-4a42-96b9-9187fcbc1ce7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:05.881263 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dbce98-3d93-4a42-96b9-9187fcbc1ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:05.905848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-50dbce98-3d93-4a42-96b9-9187fcbc1ce7 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:05.907081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-50dbce98-3d93-4a42-96b9-9187fcbc1ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:05.974021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1013/2045] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:50:05.981769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63f6f-f4dd-4a59-b6a3-96048f37ddc0 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:05.982051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63f6f-f4dd-4a59-b6a3-96048f37ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:05.982345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de63f6f-f4dd-4a59-b6a3-96048f37ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.003261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-1de63f6f-f4dd-4a59-b6a3-96048f37ddc0 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:06.004587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1de63f6f-f4dd-4a59-b6a3-96048f37ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:06.012627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1033/2046] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:06.016786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbce98-3d93-4a42-96b9-9187fcbc1ce7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:06.026683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dbce98-3d93-4a42-96b9-9187fcbc1ce7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:06.031195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed51f1c-1d34-4ea7-b259-eb3bba37f830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:06.031799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed51f1c-1d34-4ea7-b259-eb3bba37f830 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.032076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed51f1c-1d34-4ea7-b259-eb3bba37f830 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.032345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed51f1c-1d34-4ea7-b259-eb3bba37f830 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.032986 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed51f1c-1d34-4ea7-b259-eb3bba37f830 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:50:06.033284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed51f1c-1d34-4ea7-b259-eb3bba37f830 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:06.035543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed51f1c-1d34-4ea7-b259-eb3bba37f830 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:06.051308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1014/2047] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:50:06.054681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de63f6f-f4dd-4a59-b6a3-96048f37ddc0 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:06.068877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de63f6f-f4dd-4a59-b6a3-96048f37ddc0 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:06.075375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1b94f-cfa0-4488-8d27-c3306a15f2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:06.076243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1b94f-cfa0-4488-8d27-c3306a15f2ae admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.076817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1b94f-cfa0-4488-8d27-c3306a15f2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.077251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda1b94f-cfa0-4488-8d27-c3306a15f2ae admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.078069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1b94f-cfa0-4488-8d27-c3306a15f2ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:06.080034 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda1b94f-cfa0-4488-8d27-c3306a15f2ae admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:06.112078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1034/2048] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:06 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:06.118298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed51f1c-1d34-4ea7-b259-eb3bba37f830 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:06.129044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed51f1c-1d34-4ea7-b259-eb3bba37f830 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:06.195853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58d63-445d-48b0-b8d5-0b5dfb97b205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:06.196854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58d63-445d-48b0-b8d5-0b5dfb97b205 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.197141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58d63-445d-48b0-b8d5-0b5dfb97b205 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.197493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce58d63-445d-48b0-b8d5-0b5dfb97b205 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.198080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce58d63-445d-48b0-b8d5-0b5dfb97b205 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:06.200041 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce58d63-445d-48b0-b8d5-0b5dfb97b205 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:06.221274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1015/2049] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:06 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:06.226070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1b94f-cfa0-4488-8d27-c3306a15f2ae admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:06.236095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda1b94f-cfa0-4488-8d27-c3306a15f2ae admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:06.241427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c248-0f24-4dd4-9d45-8c13d4f22394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:06.242030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c248-0f24-4dd4-9d45-8c13d4f22394 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.242308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c248-0f24-4dd4-9d45-8c13d4f22394 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.242578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da6c248-0f24-4dd4-9d45-8c13d4f22394 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.243217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6c248-0f24-4dd4-9d45-8c13d4f22394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:06.244847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da6c248-0f24-4dd4-9d45-8c13d4f22394 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:06.255332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1035/2050] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:06.259065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58d63-445d-48b0-b8d5-0b5dfb97b205 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:06.269047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce58d63-445d-48b0-b8d5-0b5dfb97b205 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:06.275082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b8c911-a0b2-4485-99a5-d63de47406a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:06.275604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8c911-a0b2-4485-99a5-d63de47406a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.275909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8c911-a0b2-4485-99a5-d63de47406a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.276218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b8c911-a0b2-4485-99a5-d63de47406a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.276945 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8c911-a0b2-4485-99a5-d63de47406a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:06.278645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b8c911-a0b2-4485-99a5-d63de47406a1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:06.297191 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1016/2051] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:06.299346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c248-0f24-4dd4-9d45-8c13d4f22394 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:06.310875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da6c248-0f24-4dd4-9d45-8c13d4f22394 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:06.315636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6422c5e-714b-4fbd-bd93-b2337807c3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:06.316899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6422c5e-714b-4fbd-bd93-b2337807c3c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.317181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6422c5e-714b-4fbd-bd93-b2337807c3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.317465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6422c5e-714b-4fbd-bd93-b2337807c3c7 admin admin] PATH_INFO: `/v3/projects/2692cc7c1d9a423bba967745fd4bcfc9/users/a150ba5b034947bca2bf577855dfe1de/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.335159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6422c5e-714b-4fbd-bd93-b2337807c3c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2692cc7c1d9a423bba967745fd4bcfc9, user_id=a150ba5b034947bca2bf577855dfe1de, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:06.338240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6422c5e-714b-4fbd-bd93-b2337807c3c7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:06.354562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1036/2052] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:06 2022] PUT /identity/v3/projects/2692cc7c1d9a423bba967745fd4bcfc9/users/a150ba5b034947bca2bf577855dfe1de/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:50:06.365119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2b879-0fb2-406a-8813-3abd634443c8 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.365481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2b879-0fb2-406a-8813-3abd634443c8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.365699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f2b879-0fb2-406a-8813-3abd634443c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.396379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-39f2b879-0fb2-406a-8813-3abd634443c8 None None] MFA Rules not processed for user `a150ba5b034947bca2bf577855dfe1de`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:06.397705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-39f2b879-0fb2-406a-8813-3abd634443c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:06.452086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:06.476200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1017/2053] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:06.488185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6422c5e-714b-4fbd-bd93-b2337807c3c7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:06.490035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b6422c5e-714b-4fbd-bd93-b2337807c3c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:06.560925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6422c5e-714b-4fbd-bd93-b2337807c3c7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:06.565580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741c472-089a-407a-aa9e-7f82e1d067d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:06.567029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741c472-089a-407a-aa9e-7f82e1d067d6 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.567029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741c472-089a-407a-aa9e-7f82e1d067d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.567363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741c472-089a-407a-aa9e-7f82e1d067d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.580085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741c472-089a-407a-aa9e-7f82e1d067d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:06.582369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2741c472-089a-407a-aa9e-7f82e1d067d6 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:06.593462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1037/2054] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:06.622912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2b879-0fb2-406a-8813-3abd634443c8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:06.695586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f2b879-0fb2-406a-8813-3abd634443c8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:06.700975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:06.701867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.702260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.702771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] PATH_INFO: `/v3/users/a150ba5b034947bca2bf577855dfe1de` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.704188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a150ba5b034947bca2bf577855dfe1de)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:06.707182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:06.762799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a150ba5b034947bca2bf577855dfe1de'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:06.772543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a150ba5b034947bca2bf577855dfe1de'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:06.773848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a150ba5b034947bca2bf577855dfe1de'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:06.789843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a150ba5b034947bca2bf577855dfe1de'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:06.798470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a150ba5b034947bca2bf577855dfe1de'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:06.810030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1018/2055] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:06 2022] DELETE /identity/v3/users/a150ba5b034947bca2bf577855dfe1de => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:06.814311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dab07f-a0c8-4c80-bb44-f823a2ea4233 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.814605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dab07f-a0c8-4c80-bb44-f823a2ea4233 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.814886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dab07f-a0c8-4c80-bb44-f823a2ea4233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.835059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-06dab07f-a0c8-4c80-bb44-f823a2ea4233 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:06.836282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-06dab07f-a0c8-4c80-bb44-f823a2ea4233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:06.856721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:06.899565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1038/2056] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:50:06.909205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:06.910654 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:06.966892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd9355-45ed-4010-89d3-98f40be155bf admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:06.970527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2927e203-5a5d-4721-918f-402a95c169af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:06.971145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927e203-5a5d-4721-918f-402a95c169af service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:06.971427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927e203-5a5d-4721-918f-402a95c169af service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:06.971757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927e203-5a5d-4721-918f-402a95c169af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:06.980603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927e203-5a5d-4721-918f-402a95c169af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:06.982076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2927e203-5a5d-4721-918f-402a95c169af service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:06.991345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1019/2057] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:07.271300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dab07f-a0c8-4c80-bb44-f823a2ea4233 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:07.272884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-06dab07f-a0c8-4c80-bb44-f823a2ea4233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:07.286652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dab07f-a0c8-4c80-bb44-f823a2ea4233 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:07.291322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:07.291939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.292221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.292495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] PATH_INFO: `/v3/projects/2692cc7c1d9a423bba967745fd4bcfc9` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.293664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2692cc7c1d9a423bba967745fd4bcfc9)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:07.295609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:07.359364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2692cc7c1d9a423bba967745fd4bcfc9', 'request_id': 'req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:07.367359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2692cc7c1d9a423bba967745fd4bcfc9', 'request_id': 'req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:07.386841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2692cc7c1d9a423bba967745fd4bcfc9', 'request_id': 'req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:07.398839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] The token cache is being invalidate because project 2692cc7c1d9a423bba967745fd4bcfc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:07.399125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:07.399802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f2886a0-8ca1-4909-b109-d1cdfbe8d186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:07.401378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1039/2058] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:07 2022] DELETE /identity/v3/projects/2692cc7c1d9a423bba967745fd4bcfc9 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:07.407136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d46b3e-589b-4ce3-95dc-6e76a0144bb5 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.408293 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d46b3e-589b-4ce3-95dc-6e76a0144bb5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.408588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d46b3e-589b-4ce3-95dc-6e76a0144bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.435393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-69d46b3e-589b-4ce3-95dc-6e76a0144bb5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:07.437664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-69d46b3e-589b-4ce3-95dc-6e76a0144bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:07.452222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:07.522896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1020/2059] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:07.530516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537b337-bcb2-4471-ad88-f13bb8b74a1f None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.530809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537b337-bcb2-4471-ad88-f13bb8b74a1f None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.531083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3537b337-bcb2-4471-ad88-f13bb8b74a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.552802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3537b337-bcb2-4471-ad88-f13bb8b74a1f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:07.554057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3537b337-bcb2-4471-ad88-f13bb8b74a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:07.563964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1040/2060] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:07.574694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d46b3e-589b-4ce3-95dc-6e76a0144bb5 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:07.584809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d46b3e-589b-4ce3-95dc-6e76a0144bb5 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:07.589711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b5841-6b5f-4e57-b18c-18d01da6270f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:07.590321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5841-6b5f-4e57-b18c-18d01da6270f admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.590600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5841-6b5f-4e57-b18c-18d01da6270f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.590877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5841-6b5f-4e57-b18c-18d01da6270f admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.591520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b5841-6b5f-4e57-b18c-18d01da6270f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:50:07.591821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b5841-6b5f-4e57-b18c-18d01da6270f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:07.593505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5b5841-6b5f-4e57-b18c-18d01da6270f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:07.605341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1021/2061] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:50:07.609791 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537b337-bcb2-4471-ad88-f13bb8b74a1f None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:07.619676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3537b337-bcb2-4471-ad88-f13bb8b74a1f None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:07.624323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1dd29-61de-4890-91ac-33762cfeadd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:07.624915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1dd29-61de-4890-91ac-33762cfeadd1 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.625192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1dd29-61de-4890-91ac-33762cfeadd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.625503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1dd29-61de-4890-91ac-33762cfeadd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.626147 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1dd29-61de-4890-91ac-33762cfeadd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:07.628033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1dd29-61de-4890-91ac-33762cfeadd1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:07.655599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1041/2062] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:07 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:07.660188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b5841-6b5f-4e57-b18c-18d01da6270f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:07.670791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b5841-6b5f-4e57-b18c-18d01da6270f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:07.730099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20a3ad-d579-4797-b5bf-9965abf9e97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:07.730624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20a3ad-d579-4797-b5bf-9965abf9e97f admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.730904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20a3ad-d579-4797-b5bf-9965abf9e97f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.731181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d20a3ad-d579-4797-b5bf-9965abf9e97f admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.731823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20a3ad-d579-4797-b5bf-9965abf9e97f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:07.733784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d20a3ad-d579-4797-b5bf-9965abf9e97f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:07.758675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1022/2063] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:07 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:50:07.760614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1dd29-61de-4890-91ac-33762cfeadd1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:07.772383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1dd29-61de-4890-91ac-33762cfeadd1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:07.778321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251895c-7776-464f-8057-3850f530f58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:07.778925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251895c-7776-464f-8057-3850f530f58a admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.779201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251895c-7776-464f-8057-3850f530f58a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.779469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251895c-7776-464f-8057-3850f530f58a admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.780119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251895c-7776-464f-8057-3850f530f58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:07.781728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251895c-7776-464f-8057-3850f530f58a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:07.791949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1042/2064] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:07.795884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20a3ad-d579-4797-b5bf-9965abf9e97f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:07.808056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d20a3ad-d579-4797-b5bf-9965abf9e97f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:07.813152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87442b4-b454-43a7-a7d9-8a0bbe9cdef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:07.813826 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87442b4-b454-43a7-a7d9-8a0bbe9cdef3 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.814100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87442b4-b454-43a7-a7d9-8a0bbe9cdef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.814376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87442b4-b454-43a7-a7d9-8a0bbe9cdef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.815021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87442b4-b454-43a7-a7d9-8a0bbe9cdef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:07.817199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87442b4-b454-43a7-a7d9-8a0bbe9cdef3 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:07.830519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1023/2065] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:07.835339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251895c-7776-464f-8057-3850f530f58a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:07.852720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251895c-7776-464f-8057-3850f530f58a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:07.858283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab1aa6-dbeb-47d5-af68-69b8221ab6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:07.858935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab1aa6-dbeb-47d5-af68-69b8221ab6e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.859427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab1aa6-dbeb-47d5-af68-69b8221ab6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.859742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ab1aa6-dbeb-47d5-af68-69b8221ab6e5 admin admin] PATH_INFO: `/v3/projects/b20252dee2ca48bdbb7a9e8b470ad5c8/users/93ec2dfa15cf4e5792b4c88a953c3a1c/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.885528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab1aa6-dbeb-47d5-af68-69b8221ab6e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b20252dee2ca48bdbb7a9e8b470ad5c8, user_id=93ec2dfa15cf4e5792b4c88a953c3a1c, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:07.888218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ab1aa6-dbeb-47d5-af68-69b8221ab6e5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:07.902752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1043/2066] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:07 2022] PUT /identity/v3/projects/b20252dee2ca48bdbb7a9e8b470ad5c8/users/93ec2dfa15cf4e5792b4c88a953c3a1c/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:07.907642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c733e9-eae6-41c0-a38b-62e92930dfba None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:07.907941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c733e9-eae6-41c0-a38b-62e92930dfba None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:07.908214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c733e9-eae6-41c0-a38b-62e92930dfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:07.930870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a0c733e9-eae6-41c0-a38b-62e92930dfba None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:07.931874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a0c733e9-eae6-41c0-a38b-62e92930dfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:08.001481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1024/2067] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:08.009661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab1aa6-dbeb-47d5-af68-69b8221ab6e5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:08.011516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d6ab1aa6-dbeb-47d5-af68-69b8221ab6e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:08.061571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:08.076674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ab1aa6-dbeb-47d5-af68-69b8221ab6e5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:08.080427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f78029-4a62-4885-a17b-c77d428d26c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:08.081071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f78029-4a62-4885-a17b-c77d428d26c6 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:08.081349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f78029-4a62-4885-a17b-c77d428d26c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:08.081694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f78029-4a62-4885-a17b-c77d428d26c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:08.091255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f78029-4a62-4885-a17b-c77d428d26c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:08.092684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f78029-4a62-4885-a17b-c77d428d26c6 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:08.103008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1044/2068] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:08.774668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85737ab-5b7c-4fde-a84a-e927e9fe3a3a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:08.775100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85737ab-5b7c-4fde-a84a-e927e9fe3a3a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:08.775237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85737ab-5b7c-4fde-a84a-e927e9fe3a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:08.810980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e85737ab-5b7c-4fde-a84a-e927e9fe3a3a None None] MFA Rules not processed for user `93ec2dfa15cf4e5792b4c88a953c3a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:08.812325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e85737ab-5b7c-4fde-a84a-e927e9fe3a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:08.822838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:08.894681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1025/2069] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:08.908143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f78029-4a62-4885-a17b-c77d428d26c6 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:08.909615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d9f78029-4a62-4885-a17b-c77d428d26c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:08.994166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f78029-4a62-4885-a17b-c77d428d26c6 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:08.999104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9c778-2f33-4e9d-bb15-7a18c3b4c0fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:08.999865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9c778-2f33-4e9d-bb15-7a18c3b4c0fc service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:09.000150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9c778-2f33-4e9d-bb15-7a18c3b4c0fc service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:09.000435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e9c778-2f33-4e9d-bb15-7a18c3b4c0fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:09.012148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9c778-2f33-4e9d-bb15-7a18c3b4c0fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:09.013670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e9c778-2f33-4e9d-bb15-7a18c3b4c0fc service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:09.024586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1045/2070] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:08 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:10.436607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9c778-2f33-4e9d-bb15-7a18c3b4c0fc service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:10.437176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6543e1-d2cd-43a1-9047-6a538ced82e3 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:10.437573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6543e1-d2cd-43a1-9047-6a538ced82e3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:10.437741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6543e1-d2cd-43a1-9047-6a538ced82e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:10.438502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c9e9c778-2f33-4e9d-bb15-7a18c3b4c0fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:10.452889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e9c778-2f33-4e9d-bb15-7a18c3b4c0fc service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:10.456879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2b6543e1-d2cd-43a1-9047-6a538ced82e3 None None] MFA Rules not processed for user `93ec2dfa15cf4e5792b4c88a953c3a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:10.457621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:10.458213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2b6543e1-d2cd-43a1-9047-6a538ced82e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:10.458320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:10.458505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:10.458780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] PATH_INFO: `/v3/users/b0e321e2b55d40b9b11faf710fde0166` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:10.459896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0e321e2b55d40b9b11faf710fde0166)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:10.462116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:10.465523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1026/2071] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:10.516787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0e321e2b55d40b9b11faf710fde0166'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:10.529741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0e321e2b55d40b9b11faf710fde0166'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:10.530679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0e321e2b55d40b9b11faf710fde0166'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:10.540516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0e321e2b55d40b9b11faf710fde0166'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:10.563617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0e321e2b55d40b9b11faf710fde0166'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:10.570335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1046/2072] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:10 2022] DELETE /identity/v3/users/b0e321e2b55d40b9b11faf710fde0166 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:10.575333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628806f-93dc-4c25-bff1-e2f63b560de6 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:10.575651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628806f-93dc-4c25-bff1-e2f63b560de6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:10.575933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628806f-93dc-4c25-bff1-e2f63b560de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:10.595390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a628806f-93dc-4c25-bff1-e2f63b560de6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:10.597175 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a628806f-93dc-4c25-bff1-e2f63b560de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:10.658353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1027/2073] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:10.667349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:10.668743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:10.728866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8fd665-3ea3-4b93-9d05-ef1b6928d90b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:10.732730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d38f898-a517-4ed5-ac7e-e87042a3f9f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:10.733434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f898-a517-4ed5-ac7e-e87042a3f9f9 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:10.733851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f898-a517-4ed5-ac7e-e87042a3f9f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:10.734128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d38f898-a517-4ed5-ac7e-e87042a3f9f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:10.744246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38f898-a517-4ed5-ac7e-e87042a3f9f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:10.745846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d38f898-a517-4ed5-ac7e-e87042a3f9f9 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:10.756533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1047/2074] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:11.195742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628806f-93dc-4c25-bff1-e2f63b560de6 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:11.197443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a628806f-93dc-4c25-bff1-e2f63b560de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:11.218045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628806f-93dc-4c25-bff1-e2f63b560de6 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:11.233212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:11.234040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.234459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.234936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] PATH_INFO: `/v3/projects/5d920ecc73bf42beb6ada7fe8d033b33` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.238574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d920ecc73bf42beb6ada7fe8d033b33)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:11.240745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:11.309031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d920ecc73bf42beb6ada7fe8d033b33', 'request_id': 'req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:11.319661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d920ecc73bf42beb6ada7fe8d033b33', 'request_id': 'req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:11.326880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d920ecc73bf42beb6ada7fe8d033b33', 'request_id': 'req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:11.344395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] The token cache is being invalidate because project 5d920ecc73bf42beb6ada7fe8d033b33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:11.344762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:11.345530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-69d6b6c1-3815-4a48-9c3b-6a4a404b10fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:11.347881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1028/2075] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:11 2022] DELETE /identity/v3/projects/5d920ecc73bf42beb6ada7fe8d033b33 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:11.352626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc5320-bac6-4e06-8c01-b1edc4bf2de3 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.352913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc5320-bac6-4e06-8c01-b1edc4bf2de3 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.353212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dc5320-bac6-4e06-8c01-b1edc4bf2de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.363925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:11.380353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-24dc5320-bac6-4e06-8c01-b1edc4bf2de3 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:11.382229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-24dc5320-bac6-4e06-8c01-b1edc4bf2de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:11.494444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1048/2076] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:11.504391 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90429-79ac-43c4-91d1-bd5642fac69f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.505917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90429-79ac-43c4-91d1-bd5642fac69f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.506200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b90429-79ac-43c4-91d1-bd5642fac69f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.529977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-88b90429-79ac-43c4-91d1-bd5642fac69f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:11.531184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-88b90429-79ac-43c4-91d1-bd5642fac69f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:11.539227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1029/2077] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:11.543845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc5320-bac6-4e06-8c01-b1edc4bf2de3 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:11.554093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dc5320-bac6-4e06-8c01-b1edc4bf2de3 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:11.559441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84fd4-461e-45e3-93d3-f425978226a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:11.560078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84fd4-461e-45e3-93d3-f425978226a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.560379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84fd4-461e-45e3-93d3-f425978226a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.560638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae84fd4-461e-45e3-93d3-f425978226a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.561286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae84fd4-461e-45e3-93d3-f425978226a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:50:11.561840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae84fd4-461e-45e3-93d3-f425978226a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:11.563364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae84fd4-461e-45e3-93d3-f425978226a6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:11.576445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1049/2078] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:50:11.581911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90429-79ac-43c4-91d1-bd5642fac69f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:11.593964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b90429-79ac-43c4-91d1-bd5642fac69f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:11.600151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e3a45-8f4e-4a1c-8f5b-e15e7f2aeeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:11.601082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e3a45-8f4e-4a1c-8f5b-e15e7f2aeeb6 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.601574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e3a45-8f4e-4a1c-8f5b-e15e7f2aeeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.602005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e3a45-8f4e-4a1c-8f5b-e15e7f2aeeb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.603364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e3a45-8f4e-4a1c-8f5b-e15e7f2aeeb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:11.605611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e3a45-8f4e-4a1c-8f5b-e15e7f2aeeb6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:11.631464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:11.646885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1030/2079] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:11 2022] POST /identity/v3/projects => generated 373 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:11.651248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84fd4-461e-45e3-93d3-f425978226a6 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:11.661963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae84fd4-461e-45e3-93d3-f425978226a6 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:11.736007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda66e4d-a6f5-4d91-9d3a-f469d4ac213a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:11.738004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda66e4d-a6f5-4d91-9d3a-f469d4ac213a admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.738004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda66e4d-a6f5-4d91-9d3a-f469d4ac213a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.738004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda66e4d-a6f5-4d91-9d3a-f469d4ac213a admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.738674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda66e4d-a6f5-4d91-9d3a-f469d4ac213a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:11.740712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda66e4d-a6f5-4d91-9d3a-f469d4ac213a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:11.769688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1050/2080] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:11 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:11.773492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e3a45-8f4e-4a1c-8f5b-e15e7f2aeeb6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:11.784429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e3a45-8f4e-4a1c-8f5b-e15e7f2aeeb6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:11.790053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef4076-0d56-4de0-b698-5d694354e12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:11.790711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef4076-0d56-4de0-b698-5d694354e12d admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.791054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef4076-0d56-4de0-b698-5d694354e12d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.791345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef4076-0d56-4de0-b698-5d694354e12d admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.792154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef4076-0d56-4de0-b698-5d694354e12d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:11.794004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef4076-0d56-4de0-b698-5d694354e12d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:11.808622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1031/2081] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:11.809925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda66e4d-a6f5-4d91-9d3a-f469d4ac213a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:11.821484 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda66e4d-a6f5-4d91-9d3a-f469d4ac213a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:11.828603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd5e19-a4a0-4380-84a5-56d51e549954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:11.829241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5e19-a4a0-4380-84a5-56d51e549954 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.829579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5e19-a4a0-4380-84a5-56d51e549954 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.829862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd5e19-a4a0-4380-84a5-56d51e549954 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.830557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd5e19-a4a0-4380-84a5-56d51e549954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:11.832556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd5e19-a4a0-4380-84a5-56d51e549954 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:11.847385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1051/2082] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:11.851579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef4076-0d56-4de0-b698-5d694354e12d admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:11.864119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef4076-0d56-4de0-b698-5d694354e12d admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:11.866866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de52b51-9736-4868-8f49-1c8075984f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:11.867521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de52b51-9736-4868-8f49-1c8075984f51 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.867804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de52b51-9736-4868-8f49-1c8075984f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.868083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de52b51-9736-4868-8f49-1c8075984f51 admin admin] PATH_INFO: `/v3/projects/4b1c07ecd24d4965a98f2996ece078d7/users/55768aa930cf45a6a75939c56c12c3b6/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.884157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de52b51-9736-4868-8f49-1c8075984f51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1c07ecd24d4965a98f2996ece078d7, user_id=55768aa930cf45a6a75939c56c12c3b6, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:11.887061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de52b51-9736-4868-8f49-1c8075984f51 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:11.900129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1032/2083] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:11 2022] PUT /identity/v3/projects/4b1c07ecd24d4965a98f2996ece078d7/users/55768aa930cf45a6a75939c56c12c3b6/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:11.905223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d55817-69ab-492c-89ab-6795068d282a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:11.905926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d55817-69ab-492c-89ab-6795068d282a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:11.906273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d55817-69ab-492c-89ab-6795068d282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:11.928370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-35d55817-69ab-492c-89ab-6795068d282a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:11.929973 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-35d55817-69ab-492c-89ab-6795068d282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:12.000533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1052/2084] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:12.009987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de52b51-9736-4868-8f49-1c8075984f51 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:12.011690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7de52b51-9736-4868-8f49-1c8075984f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:12.067171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de52b51-9736-4868-8f49-1c8075984f51 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:12.071461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8372-b617-44eb-9606-f970039f1895 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:12.072096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8372-b617-44eb-9606-f970039f1895 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:12.072463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8372-b617-44eb-9606-f970039f1895 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:12.072703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adc8372-b617-44eb-9606-f970039f1895 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:12.082720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc8372-b617-44eb-9606-f970039f1895 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:12.084151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adc8372-b617-44eb-9606-f970039f1895 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:12.093746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1033/2085] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:13.196497 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf04c5-586f-4fef-8829-53ded8713e10 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:13.197030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf04c5-586f-4fef-8829-53ded8713e10 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:13.197188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bf04c5-586f-4fef-8829-53ded8713e10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:13.225772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:13.235340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c3bf04c5-586f-4fef-8829-53ded8713e10 None None] MFA Rules not processed for user `55768aa930cf45a6a75939c56c12c3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:13.237906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c3bf04c5-586f-4fef-8829-53ded8713e10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:13.315883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1053/2086] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:13.323797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8372-b617-44eb-9606-f970039f1895 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:13.325382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3adc8372-b617-44eb-9606-f970039f1895 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:13.402197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adc8372-b617-44eb-9606-f970039f1895 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:13.405995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162d6456-ae18-4f83-a030-eb0eb821a213 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:13.406645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d6456-ae18-4f83-a030-eb0eb821a213 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:13.406935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d6456-ae18-4f83-a030-eb0eb821a213 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:13.407216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162d6456-ae18-4f83-a030-eb0eb821a213 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:13.417121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d6456-ae18-4f83-a030-eb0eb821a213 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:13.419014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162d6456-ae18-4f83-a030-eb0eb821a213 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:13.431433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1034/2087] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:14.818424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33246058-0a41-460a-a2ce-f58f8b0f156b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:14.818912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33246058-0a41-460a-a2ce-f58f8b0f156b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:14.819193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33246058-0a41-460a-a2ce-f58f8b0f156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:14.842495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-33246058-0a41-460a-a2ce-f58f8b0f156b None None] MFA Rules not processed for user `55768aa930cf45a6a75939c56c12c3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:14.843721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-33246058-0a41-460a-a2ce-f58f8b0f156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:14.859931 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1054/2088] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:15.641227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329395ef-1ec1-441c-8512-bb41f8982cf4 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:15.641844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329395ef-1ec1-441c-8512-bb41f8982cf4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:15.641942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329395ef-1ec1-441c-8512-bb41f8982cf4 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:15.643764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1035/2089] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:50:15.658414 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7ee43-d5eb-40df-bd3f-6b3e58f5bc05 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:15.658760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7ee43-d5eb-40df-bd3f-6b3e58f5bc05 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:15.659235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7ee43-d5eb-40df-bd3f-6b3e58f5bc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:15.686234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329395ef-1ec1-441c-8512-bb41f8982cf4 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:15.688299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-329395ef-1ec1-441c-8512-bb41f8982cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:15.695106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-99e7ee43-d5eb-40df-bd3f-6b3e58f5bc05 None None] MFA Rules not processed for user `47fef4612fbd4d00ad8de2a2144a2ba5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:15.696450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-99e7ee43-d5eb-40df-bd3f-6b3e58f5bc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:15.704687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329395ef-1ec1-441c-8512-bb41f8982cf4 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:15.710357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:15.711290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:15.711976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:15.712252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] PATH_INFO: `/v3/users/7c0bb9948413468e82b34ac43e338fc2` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:15.713422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c0bb9948413468e82b34ac43e338fc2)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:15.715477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:15.780498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c0bb9948413468e82b34ac43e338fc2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:15.791623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c0bb9948413468e82b34ac43e338fc2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:15.792648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c0bb9948413468e82b34ac43e338fc2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:15.799744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1055/2090] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:50:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:15.808853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:15.811374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7ee43-d5eb-40df-bd3f-6b3e58f5bc05 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:15.814591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-99e7ee43-d5eb-40df-bd3f-6b3e58f5bc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:15.819304 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c0bb9948413468e82b34ac43e338fc2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:15.829535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c0bb9948413468e82b34ac43e338fc2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:15.833057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7ee43-d5eb-40df-bd3f-6b3e58f5bc05 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:15.841752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1036/2091] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:15 2022] DELETE /identity/v3/users/7c0bb9948413468e82b34ac43e338fc2 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:50:15.842671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cddab-784c-47d1-8f77-4c30eb483d72 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:15.843352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cddab-784c-47d1-8f77-4c30eb483d72 service placement] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:15.843633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cddab-784c-47d1-8f77-4c30eb483d72 service placement] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:15.843906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427cddab-784c-47d1-8f77-4c30eb483d72 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:15.886454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cddab-784c-47d1-8f77-4c30eb483d72 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:15.888047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427cddab-784c-47d1-8f77-4c30eb483d72 service placement] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:15.908087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1056/2092] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:16.332170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:16.333689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:16.441207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e95be0c-b600-4b3a-b282-69185d42701c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:16.448212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:16.448947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:16.449303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:16.449682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] PATH_INFO: `/v3/projects/fec7b37e0843464b82a69bcfc20945fb` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:16.450945 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec7b37e0843464b82a69bcfc20945fb)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:16.453029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:16.521224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec7b37e0843464b82a69bcfc20945fb', 'request_id': 'req-a069848a-9047-4c20-9c3e-b0c5dfaadfda'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.531101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec7b37e0843464b82a69bcfc20945fb', 'request_id': 'req-a069848a-9047-4c20-9c3e-b0c5dfaadfda'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.537919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec7b37e0843464b82a69bcfc20945fb', 'request_id': 'req-a069848a-9047-4c20-9c3e-b0c5dfaadfda'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.550317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] The token cache is being invalidate because project fec7b37e0843464b82a69bcfc20945fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:16.550625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.551309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.553550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1037/2093] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:16 2022] DELETE /identity/v3/projects/fec7b37e0843464b82a69bcfc20945fb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:16.557696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cddab-784c-47d1-8f77-4c30eb483d72 service placement] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:16.572176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427cddab-784c-47d1-8f77-4c30eb483d72 service placement] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:16.635307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:16.636366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:16.636900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:16.637528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] PATH_INFO: `/v3/users/783007383a094299bebc8fd69f6ccb46` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:16.639382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] RBAC: Authorizing `identity:delete_user(user_id=783007383a094299bebc8fd69f6ccb46)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:16.641717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:16.667196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:16.698531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '783007383a094299bebc8fd69f6ccb46'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.708216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '783007383a094299bebc8fd69f6ccb46'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.709371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '783007383a094299bebc8fd69f6ccb46'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.728288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '783007383a094299bebc8fd69f6ccb46'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.752992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b8ec8f85-b0f1-423e-af6f-462894bd421b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '783007383a094299bebc8fd69f6ccb46'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:16.766920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1057/2094] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:16 2022] DELETE /identity/v3/users/783007383a094299bebc8fd69f6ccb46 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:17.061363 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:17.062937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:17.079477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a069848a-9047-4c20-9c3e-b0c5dfaadfda admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:17.145055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:17.145755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.146043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.146322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] PATH_INFO: `/v3/projects/3badcee4587a4bd59feb4a60f81e0cea` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.147459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=3badcee4587a4bd59feb4a60f81e0cea)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:17.149576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:17.165351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:17.209905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3badcee4587a4bd59feb4a60f81e0cea', 'request_id': 'req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:17.219256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3badcee4587a4bd59feb4a60f81e0cea', 'request_id': 'req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:17.235964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3badcee4587a4bd59feb4a60f81e0cea', 'request_id': 'req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:17.247930 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] The token cache is being invalidate because project 3badcee4587a4bd59feb4a60f81e0cea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:17.248221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:17.248882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2ac2f351-8a1a-407b-8ad5-d87e6c002ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:17.250415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1038/2095] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:17 2022] DELETE /identity/v3/projects/3badcee4587a4bd59feb4a60f81e0cea => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:17.255716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba0d77-6c5c-4a76-8e16-d8f2ad557eac None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.256163 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba0d77-6c5c-4a76-8e16-d8f2ad557eac None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.256251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebba0d77-6c5c-4a76-8e16-d8f2ad557eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.280557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ebba0d77-6c5c-4a76-8e16-d8f2ad557eac None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:17.283874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ebba0d77-6c5c-4a76-8e16-d8f2ad557eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:17.407576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1058/2096] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:17.416388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3af283-41ea-4bda-9158-fb04907209f4 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.416970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3af283-41ea-4bda-9158-fb04907209f4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.417491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3af283-41ea-4bda-9158-fb04907209f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.439555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-af3af283-41ea-4bda-9158-fb04907209f4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:17.441269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-af3af283-41ea-4bda-9158-fb04907209f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:17.450518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1039/2097] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:17.454598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba0d77-6c5c-4a76-8e16-d8f2ad557eac None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:17.467693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebba0d77-6c5c-4a76-8e16-d8f2ad557eac None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:17.474213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e50b6d-54fb-4677-966e-aee2d026c68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:17.475419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e50b6d-54fb-4677-966e-aee2d026c68c admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.475932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e50b6d-54fb-4677-966e-aee2d026c68c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.476475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e50b6d-54fb-4677-966e-aee2d026c68c admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.477393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e50b6d-54fb-4677-966e-aee2d026c68c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:50:17.477967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e50b6d-54fb-4677-966e-aee2d026c68c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:17.480145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e50b6d-54fb-4677-966e-aee2d026c68c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:17.496313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1059/2098] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:50:17.500561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3af283-41ea-4bda-9158-fb04907209f4 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:17.524700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3af283-41ea-4bda-9158-fb04907209f4 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:17.535241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09e186-23a0-436c-912a-b3de1ff4250d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:17.536181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09e186-23a0-436c-912a-b3de1ff4250d admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.536671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09e186-23a0-436c-912a-b3de1ff4250d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.537113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09e186-23a0-436c-912a-b3de1ff4250d admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.538265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09e186-23a0-436c-912a-b3de1ff4250d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:17.540925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09e186-23a0-436c-912a-b3de1ff4250d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:17.578991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1040/2099] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:17 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:17.583693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e50b6d-54fb-4677-966e-aee2d026c68c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:17.598854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e50b6d-54fb-4677-966e-aee2d026c68c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:17.694036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1783110-18a1-47ec-9211-eb62b2b74e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:17.694648 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1783110-18a1-47ec-9211-eb62b2b74e23 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.694925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1783110-18a1-47ec-9211-eb62b2b74e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.695195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1783110-18a1-47ec-9211-eb62b2b74e23 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.695843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1783110-18a1-47ec-9211-eb62b2b74e23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:17.697780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1783110-18a1-47ec-9211-eb62b2b74e23 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:17.723442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1060/2100] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:17 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:17.727548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09e186-23a0-436c-912a-b3de1ff4250d admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:17.738929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09e186-23a0-436c-912a-b3de1ff4250d admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:17.743632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e6e3-4635-4e0a-ae50-45d316818916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:17.744244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e6e3-4635-4e0a-ae50-45d316818916 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.744523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e6e3-4635-4e0a-ae50-45d316818916 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.744829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e6e3-4635-4e0a-ae50-45d316818916 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.745505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680e6e3-4635-4e0a-ae50-45d316818916 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:17.747126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f680e6e3-4635-4e0a-ae50-45d316818916 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:17.758131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1041/2101] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:17.762179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1783110-18a1-47ec-9211-eb62b2b74e23 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:17.772813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1783110-18a1-47ec-9211-eb62b2b74e23 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:17.777557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4fb350-2e33-4e42-af50-ff0d360d02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:17.778182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb350-2e33-4e42-af50-ff0d360d02f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.778461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb350-2e33-4e42-af50-ff0d360d02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.778731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4fb350-2e33-4e42-af50-ff0d360d02f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.779404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fb350-2e33-4e42-af50-ff0d360d02f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:17.780988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4fb350-2e33-4e42-af50-ff0d360d02f5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:17.792164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1061/2102] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:17.798651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e6e3-4635-4e0a-ae50-45d316818916 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:17.810188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e6e3-4635-4e0a-ae50-45d316818916 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:17.814831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ddc1f-37fe-4f02-a3fd-90a37e3fb6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:17.816153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ddc1f-37fe-4f02-a3fd-90a37e3fb6f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.816580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ddc1f-37fe-4f02-a3fd-90a37e3fb6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.816841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7ddc1f-37fe-4f02-a3fd-90a37e3fb6f6 admin admin] PATH_INFO: `/v3/projects/5fe3c1f837de408ebfc50f52e1a29a2b/users/1d68cfff9e914d4b9b8fb31b5745eb7c/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.832138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ddc1f-37fe-4f02-a3fd-90a37e3fb6f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe3c1f837de408ebfc50f52e1a29a2b, user_id=1d68cfff9e914d4b9b8fb31b5745eb7c, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:17.834780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7ddc1f-37fe-4f02-a3fd-90a37e3fb6f6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:17.848164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1042/2103] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:17 2022] PUT /identity/v3/projects/5fe3c1f837de408ebfc50f52e1a29a2b/users/1d68cfff9e914d4b9b8fb31b5745eb7c/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:17.858294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a45fc-cdac-4625-87db-fd1e9b22d2fe None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:17.858598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a45fc-cdac-4625-87db-fd1e9b22d2fe None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:17.858874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a45fc-cdac-4625-87db-fd1e9b22d2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:17.866571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:17.891691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b27a45fc-cdac-4625-87db-fd1e9b22d2fe None None] MFA Rules not processed for user `1d68cfff9e914d4b9b8fb31b5745eb7c`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:17.893577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b27a45fc-cdac-4625-87db-fd1e9b22d2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:17.960351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1062/2104] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:17.971859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ddc1f-37fe-4f02-a3fd-90a37e3fb6f6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:17.973800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bf7ddc1f-37fe-4f02-a3fd-90a37e3fb6f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:18.030157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7ddc1f-37fe-4f02-a3fd-90a37e3fb6f6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:18.033993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b17ba-da39-446f-8795-0c30887a3b9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:18.034611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b17ba-da39-446f-8795-0c30887a3b9b service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:18.034890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b17ba-da39-446f-8795-0c30887a3b9b service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:18.035164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b17ba-da39-446f-8795-0c30887a3b9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:18.043488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b17ba-da39-446f-8795-0c30887a3b9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:18.044928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b17ba-da39-446f-8795-0c30887a3b9b service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:18.054697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1043/2105] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:18.078685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a45fc-cdac-4625-87db-fd1e9b22d2fe None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:18.144712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a45fc-cdac-4625-87db-fd1e9b22d2fe None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:18.149561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:18.150202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:18.150479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:18.150753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] PATH_INFO: `/v3/users/1d68cfff9e914d4b9b8fb31b5745eb7c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:18.151887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d68cfff9e914d4b9b8fb31b5745eb7c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:18.153988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:18.220839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d68cfff9e914d4b9b8fb31b5745eb7c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.229241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d68cfff9e914d4b9b8fb31b5745eb7c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.230483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d68cfff9e914d4b9b8fb31b5745eb7c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.239131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d68cfff9e914d4b9b8fb31b5745eb7c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.252279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d68cfff9e914d4b9b8fb31b5745eb7c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.258757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1063/2106] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:18 2022] DELETE /identity/v3/users/1d68cfff9e914d4b9b8fb31b5745eb7c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:18.263289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393992-f64d-4a1b-a07b-7f8a5a96e7af None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:18.263644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393992-f64d-4a1b-a07b-7f8a5a96e7af None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:18.263732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68393992-f64d-4a1b-a07b-7f8a5a96e7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:18.285383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-68393992-f64d-4a1b-a07b-7f8a5a96e7af None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:18.286787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-68393992-f64d-4a1b-a07b-7f8a5a96e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:18.323556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:18.355265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1044/2107] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:50:18.365742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:18.367159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:18.390817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:18.464071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a07f21-d25d-4ebf-881c-ffa82c9e1cb5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:18.470831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4152cd-c01b-4826-95fb-60a323cd0017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:18.471938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4152cd-c01b-4826-95fb-60a323cd0017 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:18.472384 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4152cd-c01b-4826-95fb-60a323cd0017 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:18.472752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4152cd-c01b-4826-95fb-60a323cd0017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:18.482942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4152cd-c01b-4826-95fb-60a323cd0017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:18.484853 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4152cd-c01b-4826-95fb-60a323cd0017 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:18.498086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1064/2108] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:18.786000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68393992-f64d-4a1b-a07b-7f8a5a96e7af None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:18.788122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-68393992-f64d-4a1b-a07b-7f8a5a96e7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:18.807938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68393992-f64d-4a1b-a07b-7f8a5a96e7af None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:18.816233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:18.817281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:18.817773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:18.818200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] PATH_INFO: `/v3/projects/5fe3c1f837de408ebfc50f52e1a29a2b` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:18.819956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe3c1f837de408ebfc50f52e1a29a2b)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:18.822892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:18.877838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe3c1f837de408ebfc50f52e1a29a2b', 'request_id': 'req-ace018da-248b-4352-98f7-c3f3f1a34f7c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.885105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe3c1f837de408ebfc50f52e1a29a2b', 'request_id': 'req-ace018da-248b-4352-98f7-c3f3f1a34f7c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.891101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe3c1f837de408ebfc50f52e1a29a2b', 'request_id': 'req-ace018da-248b-4352-98f7-c3f3f1a34f7c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.901821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] The token cache is being invalidate because project 5fe3c1f837de408ebfc50f52e1a29a2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:18.902103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.902741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ace018da-248b-4352-98f7-c3f3f1a34f7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:18.904210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1045/2109] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:18 2022] DELETE /identity/v3/projects/5fe3c1f837de408ebfc50f52e1a29a2b => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:50:18.909619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174c70f-b9e8-4e18-abfb-8f4f129c8775 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:18.909905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174c70f-b9e8-4e18-abfb-8f4f129c8775 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:18.910177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a174c70f-b9e8-4e18-abfb-8f4f129c8775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:18.929774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a174c70f-b9e8-4e18-abfb-8f4f129c8775 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:18.930962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a174c70f-b9e8-4e18-abfb-8f4f129c8775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:18.987770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1065/2110] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:18.995405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978f81e-79ee-42fc-ae65-16c7cf3aa340 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:18.995689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978f81e-79ee-42fc-ae65-16c7cf3aa340 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:18.996020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f978f81e-79ee-42fc-ae65-16c7cf3aa340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.015367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f978f81e-79ee-42fc-ae65-16c7cf3aa340 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:19.016573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f978f81e-79ee-42fc-ae65-16c7cf3aa340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:19.024446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1046/2111] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:19.028506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174c70f-b9e8-4e18-abfb-8f4f129c8775 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.038788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a174c70f-b9e8-4e18-abfb-8f4f129c8775 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.043559 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94423a3-163b-4bd0-a6f1-1904328643e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.044158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94423a3-163b-4bd0-a6f1-1904328643e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.044441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94423a3-163b-4bd0-a6f1-1904328643e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.044717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94423a3-163b-4bd0-a6f1-1904328643e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.045368 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94423a3-163b-4bd0-a6f1-1904328643e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:50:19.045704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94423a3-163b-4bd0-a6f1-1904328643e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.047289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94423a3-163b-4bd0-a6f1-1904328643e1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.059944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1066/2112] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:50:19.063921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978f81e-79ee-42fc-ae65-16c7cf3aa340 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.076318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f978f81e-79ee-42fc-ae65-16c7cf3aa340 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.081017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f1f5d-e758-40f4-bec0-e0dbaa530416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.081657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f1f5d-e758-40f4-bec0-e0dbaa530416 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.081937 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f1f5d-e758-40f4-bec0-e0dbaa530416 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.082210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9f1f5d-e758-40f4-bec0-e0dbaa530416 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.082848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f1f5d-e758-40f4-bec0-e0dbaa530416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.084766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9f1f5d-e758-40f4-bec0-e0dbaa530416 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.112834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1047/2113] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:19 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:19.116826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94423a3-163b-4bd0-a6f1-1904328643e1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.128661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94423a3-163b-4bd0-a6f1-1904328643e1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.184257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0621ea7-f8dc-4875-87b7-acd2861561c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.184776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0621ea7-f8dc-4875-87b7-acd2861561c7 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.185055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0621ea7-f8dc-4875-87b7-acd2861561c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.185327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0621ea7-f8dc-4875-87b7-acd2861561c7 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.185984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0621ea7-f8dc-4875-87b7-acd2861561c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.187888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0621ea7-f8dc-4875-87b7-acd2861561c7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.210023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1067/2114] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:19 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:19.214254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f1f5d-e758-40f4-bec0-e0dbaa530416 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.225241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9f1f5d-e758-40f4-bec0-e0dbaa530416 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.231035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6163470-6f47-47bb-a230-231912b66020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.231745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6163470-6f47-47bb-a230-231912b66020 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.232119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6163470-6f47-47bb-a230-231912b66020 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.233056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6163470-6f47-47bb-a230-231912b66020 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.233342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6163470-6f47-47bb-a230-231912b66020 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.235149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6163470-6f47-47bb-a230-231912b66020 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.249050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1048/2115] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:19.250252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0621ea7-f8dc-4875-87b7-acd2861561c7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.262579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0621ea7-f8dc-4875-87b7-acd2861561c7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.267413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6358cb73-ea93-4680-9a70-84bb4af82655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.268639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358cb73-ea93-4680-9a70-84bb4af82655 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.268982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358cb73-ea93-4680-9a70-84bb4af82655 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.269318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6358cb73-ea93-4680-9a70-84bb4af82655 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.270055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358cb73-ea93-4680-9a70-84bb4af82655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.271727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6358cb73-ea93-4680-9a70-84bb4af82655 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.282612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1068/2116] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:50:19.287456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6163470-6f47-47bb-a230-231912b66020 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.297889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6163470-6f47-47bb-a230-231912b66020 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.302535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b90ce-07bb-4c1e-a33c-c606b53fc56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.303183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b90ce-07bb-4c1e-a33c-c606b53fc56e admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.303463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b90ce-07bb-4c1e-a33c-c606b53fc56e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.303735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7b90ce-07bb-4c1e-a33c-c606b53fc56e admin admin] PATH_INFO: `/v3/projects/66dd383cff594849896005ae8609c79f/users/4bc37a07ca1b4fd08a52ebb4baa15b6d/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.319370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b90ce-07bb-4c1e-a33c-c606b53fc56e admin admin] RBAC: Authorizing `identity:create_grant(project_id=66dd383cff594849896005ae8609c79f, user_id=4bc37a07ca1b4fd08a52ebb4baa15b6d, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.322428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7b90ce-07bb-4c1e-a33c-c606b53fc56e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.338086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1049/2117] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:19 2022] PUT /identity/v3/projects/66dd383cff594849896005ae8609c79f/users/4bc37a07ca1b4fd08a52ebb4baa15b6d/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:19.349539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341f33a-5e4c-4646-a7e8-51cfa8905ebc None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.349938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341f33a-5e4c-4646-a7e8-51cfa8905ebc None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.350320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c341f33a-5e4c-4646-a7e8-51cfa8905ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.380785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c341f33a-5e4c-4646-a7e8-51cfa8905ebc None None] MFA Rules not processed for user `4bc37a07ca1b4fd08a52ebb4baa15b6d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:19.382568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c341f33a-5e4c-4646-a7e8-51cfa8905ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:19.393633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:19.462905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1069/2118] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:50:19.467440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b90ce-07bb-4c1e-a33c-c606b53fc56e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.563288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7b90ce-07bb-4c1e-a33c-c606b53fc56e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.594581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bc634-5e4d-44a1-957e-acc6eae82a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.598974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bc634-5e4d-44a1-957e-acc6eae82a8b admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.599373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bc634-5e4d-44a1-957e-acc6eae82a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.599733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bc634-5e4d-44a1-957e-acc6eae82a8b admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.600464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bc634-5e4d-44a1-957e-acc6eae82a8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.602574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bc634-5e4d-44a1-957e-acc6eae82a8b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.608197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:19.640337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1050/2119] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:19 2022] POST /identity/v3/projects => generated 375 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:19.641679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341f33a-5e4c-4646-a7e8-51cfa8905ebc None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.653229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c341f33a-5e4c-4646-a7e8-51cfa8905ebc None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.720921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96fdde-3d0f-4a9d-a64d-216e836bdbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.722081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96fdde-3d0f-4a9d-a64d-216e836bdbe6 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.722363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96fdde-3d0f-4a9d-a64d-216e836bdbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.722640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed96fdde-3d0f-4a9d-a64d-216e836bdbe6 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.723329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96fdde-3d0f-4a9d-a64d-216e836bdbe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.725215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed96fdde-3d0f-4a9d-a64d-216e836bdbe6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.757657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1070/2120] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:19 2022] POST /identity/v3/users => generated 294 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:19.759846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bc634-5e4d-44a1-957e-acc6eae82a8b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.777862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bc634-5e4d-44a1-957e-acc6eae82a8b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.784655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3612ae-34ff-4292-b9c5-3b966e8197c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.785388 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3612ae-34ff-4292-b9c5-3b966e8197c1 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.785637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3612ae-34ff-4292-b9c5-3b966e8197c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.785987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3612ae-34ff-4292-b9c5-3b966e8197c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.786712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3612ae-34ff-4292-b9c5-3b966e8197c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.788548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3612ae-34ff-4292-b9c5-3b966e8197c1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.804475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96fdde-3d0f-4a9d-a64d-216e836bdbe6 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.805482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1051/2121] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:19.814833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed96fdde-3d0f-4a9d-a64d-216e836bdbe6 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.821152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bc61b-e6df-4428-a81e-ed122c60a57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.821919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bc61b-e6df-4428-a81e-ed122c60a57c admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.822273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bc61b-e6df-4428-a81e-ed122c60a57c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.822436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80bc61b-e6df-4428-a81e-ed122c60a57c admin admin] PATH_INFO: `/v3/projects/59fbf104fd3a44d8b055f603e668eb15/users/b5a5c5aa0c86428681fb5f9a5bae81d3/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.842756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bc61b-e6df-4428-a81e-ed122c60a57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fbf104fd3a44d8b055f603e668eb15, user_id=b5a5c5aa0c86428681fb5f9a5bae81d3, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.846895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80bc61b-e6df-4428-a81e-ed122c60a57c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.877731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1071/2122] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:19 2022] PUT /identity/v3/projects/59fbf104fd3a44d8b055f603e668eb15/users/b5a5c5aa0c86428681fb5f9a5bae81d3/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:50:19.879538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3612ae-34ff-4292-b9c5-3b966e8197c1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:19.894095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3612ae-34ff-4292-b9c5-3b966e8197c1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:19.983390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b595ea7-c224-4652-8751-89e22f824909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:19.984011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b595ea7-c224-4652-8751-89e22f824909 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:19.984287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b595ea7-c224-4652-8751-89e22f824909 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:19.984556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b595ea7-c224-4652-8751-89e22f824909 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:19.985212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b595ea7-c224-4652-8751-89e22f824909 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:19.987440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b595ea7-c224-4652-8751-89e22f824909 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:19.999236 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1052/2123] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:19 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:20.004337 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bc61b-e6df-4428-a81e-ed122c60a57c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:20.015386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80bc61b-e6df-4428-a81e-ed122c60a57c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:20.022216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6a54-fab7-4c21-aeed-275692117624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:20.023251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6a54-fab7-4c21-aeed-275692117624 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:20.023831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6a54-fab7-4c21-aeed-275692117624 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:20.024285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d6a54-fab7-4c21-aeed-275692117624 admin admin] PATH_INFO: `/v3/projects/59fbf104fd3a44d8b055f603e668eb15/users/b5a5c5aa0c86428681fb5f9a5bae81d3/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:20.026434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6a54-fab7-4c21-aeed-275692117624 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59fbf104fd3a44d8b055f603e668eb15, user_id=b5a5c5aa0c86428681fb5f9a5bae81d3, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:20.029165 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d6a54-fab7-4c21-aeed-275692117624 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:20.040194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1072/2124] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:20 2022] PUT /identity/v3/projects/59fbf104fd3a44d8b055f603e668eb15/users/b5a5c5aa0c86428681fb5f9a5bae81d3/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:20.051113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092a8b2-bd42-4e40-8d1c-2e866a948c0e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:20.051402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092a8b2-bd42-4e40-8d1c-2e866a948c0e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:20.051677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2092a8b2-bd42-4e40-8d1c-2e866a948c0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:20.081721 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2092a8b2-bd42-4e40-8d1c-2e866a948c0e None None] MFA Rules not processed for user `b5a5c5aa0c86428681fb5f9a5bae81d3`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:20.082924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2092a8b2-bd42-4e40-8d1c-2e866a948c0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:20.156099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1053/2125] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:20.169141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6a54-fab7-4c21-aeed-275692117624 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:20.170924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-723d6a54-fab7-4c21-aeed-275692117624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:20.234172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d6a54-fab7-4c21-aeed-275692117624 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:20.237875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9831c721-98eb-4417-b561-0e766bacb34a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:20.238493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c721-98eb-4417-b561-0e766bacb34a service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:20.238767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c721-98eb-4417-b561-0e766bacb34a service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:20.239033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9831c721-98eb-4417-b561-0e766bacb34a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:20.252807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:20.305427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831c721-98eb-4417-b561-0e766bacb34a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:20.306933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9831c721-98eb-4417-b561-0e766bacb34a service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:20.316922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1073/2126] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:22.913551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092a8b2-bd42-4e40-8d1c-2e866a948c0e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:22.976003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:22.983005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2092a8b2-bd42-4e40-8d1c-2e866a948c0e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:22.989138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:22.989852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:22.990136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:22.990416 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] PATH_INFO: `/v3/users/4bc37a07ca1b4fd08a52ebb4baa15b6d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:22.991572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bc37a07ca1b4fd08a52ebb4baa15b6d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:22.993578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:23.041353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bc37a07ca1b4fd08a52ebb4baa15b6d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.048814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bc37a07ca1b4fd08a52ebb4baa15b6d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.049502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bc37a07ca1b4fd08a52ebb4baa15b6d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.062512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bc37a07ca1b4fd08a52ebb4baa15b6d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.073621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bc37a07ca1b4fd08a52ebb4baa15b6d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.080796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1054/2127] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:22 2022] DELETE /identity/v3/users/4bc37a07ca1b4fd08a52ebb4baa15b6d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:23.085381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb087bd-ee17-4e7f-a473-42ed304fdd43 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:23.085884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb087bd-ee17-4e7f-a473-42ed304fdd43 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:23.085976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb087bd-ee17-4e7f-a473-42ed304fdd43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:23.107348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ddb087bd-ee17-4e7f-a473-42ed304fdd43 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:23.108585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ddb087bd-ee17-4e7f-a473-42ed304fdd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:23.167250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1074/2128] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:23.177035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:23.178478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:23.235328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099eb261-872a-43c9-9f85-b7c7a57570c7 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:23.239089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d9d3-f48d-4f0f-9c43-3deb629425fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:23.239699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d9d3-f48d-4f0f-9c43-3deb629425fc service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:23.239982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d9d3-f48d-4f0f-9c43-3deb629425fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:23.240258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5d9d3-f48d-4f0f-9c43-3deb629425fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:23.249247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5d9d3-f48d-4f0f-9c43-3deb629425fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:23.250729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d5d9d3-f48d-4f0f-9c43-3deb629425fc service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:23.260682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1055/2129] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:23.558504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb087bd-ee17-4e7f-a473-42ed304fdd43 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:23.560244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ddb087bd-ee17-4e7f-a473-42ed304fdd43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:23.591417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb087bd-ee17-4e7f-a473-42ed304fdd43 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:23.596586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:23.597221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:23.597537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:23.597815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] PATH_INFO: `/v3/projects/66dd383cff594849896005ae8609c79f` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:23.598951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66dd383cff594849896005ae8609c79f)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:23.601517 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:23.671741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66dd383cff594849896005ae8609c79f', 'request_id': 'req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.681633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66dd383cff594849896005ae8609c79f', 'request_id': 'req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.691354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66dd383cff594849896005ae8609c79f', 'request_id': 'req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.713141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] The token cache is being invalidate because project 66dd383cff594849896005ae8609c79f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:23.713763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.715201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.717860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1075/2130] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:23 2022] DELETE /identity/v3/projects/66dd383cff594849896005ae8609c79f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:23.725575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d9d3-f48d-4f0f-9c43-3deb629425fc service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:23.736104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5d9d3-f48d-4f0f-9c43-3deb629425fc service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:23.796923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:23.797554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:23.797892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:23.798193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] PATH_INFO: `/v3/users/b5a5c5aa0c86428681fb5f9a5bae81d3` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:23.799773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5a5c5aa0c86428681fb5f9a5bae81d3)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:23.801936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:23.823875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:23.850400 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5a5c5aa0c86428681fb5f9a5bae81d3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.859516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5a5c5aa0c86428681fb5f9a5bae81d3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.860306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5a5c5aa0c86428681fb5f9a5bae81d3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.872341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5a5c5aa0c86428681fb5f9a5bae81d3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.879117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e2b4018a-40da-4d95-9c39-172d9a58d5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5a5c5aa0c86428681fb5f9a5bae81d3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:23.884914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1056/2131] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:23 2022] DELETE /identity/v3/users/b5a5c5aa0c86428681fb5f9a5bae81d3 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:24.150614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:24.152080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:24.164893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f1e542-e8a1-4c7d-ac48-0fe6bcc2fed7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:24.204149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:24.224759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:24.225429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.225730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.226004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] PATH_INFO: `/v3/projects/59fbf104fd3a44d8b055f603e668eb15` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.227177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=59fbf104fd3a44d8b055f603e668eb15)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:24.229122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:24.277857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59fbf104fd3a44d8b055f603e668eb15', 'request_id': 'req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:24.285591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59fbf104fd3a44d8b055f603e668eb15', 'request_id': 'req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:24.291050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59fbf104fd3a44d8b055f603e668eb15', 'request_id': 'req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:24.304598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] The token cache is being invalidate because project 59fbf104fd3a44d8b055f603e668eb15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:24.304898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:24.305599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-507df5e3-3976-4dcf-b3c7-d5abb71f6e9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:24.307348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1076/2132] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:24 2022] DELETE /identity/v3/projects/59fbf104fd3a44d8b055f603e668eb15 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:50:24.312323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48306190-09ac-4e83-8846-3f808a7bb6d3 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.312790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48306190-09ac-4e83-8846-3f808a7bb6d3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.312898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48306190-09ac-4e83-8846-3f808a7bb6d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.332514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-48306190-09ac-4e83-8846-3f808a7bb6d3 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:24.333685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-48306190-09ac-4e83-8846-3f808a7bb6d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:24.395174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1057/2133] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:24.402773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe24fb-2dc4-4e5e-aecf-52596c79ecf6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.403064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe24fb-2dc4-4e5e-aecf-52596c79ecf6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.403340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fe24fb-2dc4-4e5e-aecf-52596c79ecf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.424877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-31fe24fb-2dc4-4e5e-aecf-52596c79ecf6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:24.426137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-31fe24fb-2dc4-4e5e-aecf-52596c79ecf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:24.437154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1077/2134] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:24.441680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48306190-09ac-4e83-8846-3f808a7bb6d3 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:24.451901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48306190-09ac-4e83-8846-3f808a7bb6d3 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:24.456765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a1c4-71e4-4609-99af-c1a7ecfe5c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:24.457505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a1c4-71e4-4609-99af-c1a7ecfe5c29 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.457865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a1c4-71e4-4609-99af-c1a7ecfe5c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.458232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954a1c4-71e4-4609-99af-c1a7ecfe5c29 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.458945 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954a1c4-71e4-4609-99af-c1a7ecfe5c29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:50:24.459312 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954a1c4-71e4-4609-99af-c1a7ecfe5c29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:24.461007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954a1c4-71e4-4609-99af-c1a7ecfe5c29 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:24.473974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1058/2135] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:50:24.478252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe24fb-2dc4-4e5e-aecf-52596c79ecf6 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:24.488168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fe24fb-2dc4-4e5e-aecf-52596c79ecf6 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:24.492922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20365-6f51-41da-b9e5-bca3945ec0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:24.493696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20365-6f51-41da-b9e5-bca3945ec0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.493975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20365-6f51-41da-b9e5-bca3945ec0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.494326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef20365-6f51-41da-b9e5-bca3945ec0b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.495107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20365-6f51-41da-b9e5-bca3945ec0b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:24.497260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef20365-6f51-41da-b9e5-bca3945ec0b7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:24.529302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1078/2136] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:24 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:24.535423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a1c4-71e4-4609-99af-c1a7ecfe5c29 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:24.549097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954a1c4-71e4-4609-99af-c1a7ecfe5c29 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:24.638120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcd853-5364-4d4a-96a6-3570cd0b673b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:24.638752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd853-5364-4d4a-96a6-3570cd0b673b admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.639030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd853-5364-4d4a-96a6-3570cd0b673b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.639308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fcd853-5364-4d4a-96a6-3570cd0b673b admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.640110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcd853-5364-4d4a-96a6-3570cd0b673b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:24.649870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fcd853-5364-4d4a-96a6-3570cd0b673b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:24.672859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1059/2137] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:24 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:24.677758 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20365-6f51-41da-b9e5-bca3945ec0b7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:24.693755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef20365-6f51-41da-b9e5-bca3945ec0b7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:24.699885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552addfe-5b54-483c-a637-2928f6a22ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:24.700493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552addfe-5b54-483c-a637-2928f6a22ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.700775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552addfe-5b54-483c-a637-2928f6a22ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.701050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552addfe-5b54-483c-a637-2928f6a22ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.702682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552addfe-5b54-483c-a637-2928f6a22ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:24.703393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552addfe-5b54-483c-a637-2928f6a22ec8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:24.716589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1079/2138] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:50:24.719374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcd853-5364-4d4a-96a6-3570cd0b673b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:24.732716 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fcd853-5364-4d4a-96a6-3570cd0b673b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:24.737519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2daa183-3938-417b-b03c-4ce501e74e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:24.738199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa183-3938-417b-b03c-4ce501e74e8d admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.738481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa183-3938-417b-b03c-4ce501e74e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.738755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2daa183-3938-417b-b03c-4ce501e74e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.739393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daa183-3938-417b-b03c-4ce501e74e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:24.741009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2daa183-3938-417b-b03c-4ce501e74e8d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:24.752479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1060/2139] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:24.756531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552addfe-5b54-483c-a637-2928f6a22ec8 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:24.768418 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552addfe-5b54-483c-a637-2928f6a22ec8 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:24.773292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365d5f6-ee2d-4c2d-aa95-fa5915c482d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:24.774042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365d5f6-ee2d-4c2d-aa95-fa5915c482d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.774392 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365d5f6-ee2d-4c2d-aa95-fa5915c482d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.775344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365d5f6-ee2d-4c2d-aa95-fa5915c482d1 admin admin] PATH_INFO: `/v3/projects/5fb1fd2d3639471d84129c8134e23b3c/users/1a18c34d807c46448d0cd866ef1c8758/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.795784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365d5f6-ee2d-4c2d-aa95-fa5915c482d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fb1fd2d3639471d84129c8134e23b3c, user_id=1a18c34d807c46448d0cd866ef1c8758, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:24.802096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365d5f6-ee2d-4c2d-aa95-fa5915c482d1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:24.819388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1080/2140] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:24 2022] PUT /identity/v3/projects/5fb1fd2d3639471d84129c8134e23b3c/users/1a18c34d807c46448d0cd866ef1c8758/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:24.888998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86eb6b-8e6f-4feb-9faa-3b902132de19 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:24.889285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86eb6b-8e6f-4feb-9faa-3b902132de19 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:24.889624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be86eb6b-8e6f-4feb-9faa-3b902132de19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:24.897493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:24.942098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-be86eb6b-8e6f-4feb-9faa-3b902132de19 None None] MFA Rules not processed for user `1a18c34d807c46448d0cd866ef1c8758`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:24.943530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-be86eb6b-8e6f-4feb-9faa-3b902132de19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:25.016404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1061/2141] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:25.021254 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365d5f6-ee2d-4c2d-aa95-fa5915c482d1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.095754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365d5f6-ee2d-4c2d-aa95-fa5915c482d1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.101566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687ecf0-a7bb-4626-8650-d5b49391cbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.102105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ecf0-a7bb-4626-8650-d5b49391cbdf admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.102381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ecf0-a7bb-4626-8650-d5b49391cbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.102650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687ecf0-a7bb-4626-8650-d5b49391cbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.103279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687ecf0-a7bb-4626-8650-d5b49391cbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.105352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687ecf0-a7bb-4626-8650-d5b49391cbdf admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.117948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:25.139948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1081/2142] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:25 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:25.141123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86eb6b-8e6f-4feb-9faa-3b902132de19 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.153623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be86eb6b-8e6f-4feb-9faa-3b902132de19 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.210902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367d111-21e0-4217-a29a-fc50eaf8e896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.211510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367d111-21e0-4217-a29a-fc50eaf8e896 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.212055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367d111-21e0-4217-a29a-fc50eaf8e896 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.212331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367d111-21e0-4217-a29a-fc50eaf8e896 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.212968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367d111-21e0-4217-a29a-fc50eaf8e896 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.214973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367d111-21e0-4217-a29a-fc50eaf8e896 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.239407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1062/2143] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:25 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:50:25.243178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687ecf0-a7bb-4626-8650-d5b49391cbdf admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.253747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687ecf0-a7bb-4626-8650-d5b49391cbdf admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.258384 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15928ea-f600-49f5-9f90-2036e2670379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.258987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15928ea-f600-49f5-9f90-2036e2670379 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.259354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15928ea-f600-49f5-9f90-2036e2670379 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.259617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15928ea-f600-49f5-9f90-2036e2670379 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.260269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15928ea-f600-49f5-9f90-2036e2670379 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.261906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15928ea-f600-49f5-9f90-2036e2670379 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.272870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1082/2144] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:25.276738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367d111-21e0-4217-a29a-fc50eaf8e896 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.287137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367d111-21e0-4217-a29a-fc50eaf8e896 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.291776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dbbe03-b4a4-4a5a-b775-1d0d13010653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.292375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbbe03-b4a4-4a5a-b775-1d0d13010653 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.292658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbbe03-b4a4-4a5a-b775-1d0d13010653 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.292935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dbbe03-b4a4-4a5a-b775-1d0d13010653 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.293631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbbe03-b4a4-4a5a-b775-1d0d13010653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.295264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dbbe03-b4a4-4a5a-b775-1d0d13010653 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.305181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1063/2145] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:25.309365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15928ea-f600-49f5-9f90-2036e2670379 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.319706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15928ea-f600-49f5-9f90-2036e2670379 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.324328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a7171-82bb-4928-8acf-85a958036dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.324966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a7171-82bb-4928-8acf-85a958036dbb admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.325247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a7171-82bb-4928-8acf-85a958036dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.325565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4a7171-82bb-4928-8acf-85a958036dbb admin admin] PATH_INFO: `/v3/projects/a7a65362d68b4664850f58a20e5f0779/users/ad7dfac6d903455e994c763613c3374b/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.340709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a7171-82bb-4928-8acf-85a958036dbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7a65362d68b4664850f58a20e5f0779, user_id=ad7dfac6d903455e994c763613c3374b, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.343409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4a7171-82bb-4928-8acf-85a958036dbb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.358112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1083/2146] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:25 2022] PUT /identity/v3/projects/a7a65362d68b4664850f58a20e5f0779/users/ad7dfac6d903455e994c763613c3374b/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:25.368326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b02437-1806-48ff-8bba-8679fcb78407 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.368772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b02437-1806-48ff-8bba-8679fcb78407 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.368885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b02437-1806-48ff-8bba-8679fcb78407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.396996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-71b02437-1806-48ff-8bba-8679fcb78407 None None] MFA Rules not processed for user `ad7dfac6d903455e994c763613c3374b`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:25.398243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-71b02437-1806-48ff-8bba-8679fcb78407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:25.458714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:25.466978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1064/2147] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:25.468056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a7171-82bb-4928-8acf-85a958036dbb admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.528397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4a7171-82bb-4928-8acf-85a958036dbb admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.533058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6b580-8ba8-4cdd-8a01-4fc50ba55e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.533688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6b580-8ba8-4cdd-8a01-4fc50ba55e2f admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.533974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6b580-8ba8-4cdd-8a01-4fc50ba55e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.534249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda6b580-8ba8-4cdd-8a01-4fc50ba55e2f admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.534872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6b580-8ba8-4cdd-8a01-4fc50ba55e2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.536798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda6b580-8ba8-4cdd-8a01-4fc50ba55e2f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.563818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1084/2148] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:25 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:25.567955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b02437-1806-48ff-8bba-8679fcb78407 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.578901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b02437-1806-48ff-8bba-8679fcb78407 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.634989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246aa3c-916a-4da1-a558-33e3fc683a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.635517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246aa3c-916a-4da1-a558-33e3fc683a77 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.635797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246aa3c-916a-4da1-a558-33e3fc683a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.636071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b246aa3c-916a-4da1-a558-33e3fc683a77 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.636712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246aa3c-916a-4da1-a558-33e3fc683a77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.638670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b246aa3c-916a-4da1-a558-33e3fc683a77 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.660138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1065/2149] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:25 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:50:25.664065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6b580-8ba8-4cdd-8a01-4fc50ba55e2f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.674721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda6b580-8ba8-4cdd-8a01-4fc50ba55e2f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.679276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c6d88-2498-4b51-8109-586de62fef8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.679868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c6d88-2498-4b51-8109-586de62fef8e admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.680150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c6d88-2498-4b51-8109-586de62fef8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.680422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c6d88-2498-4b51-8109-586de62fef8e admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.681099 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c6d88-2498-4b51-8109-586de62fef8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.682746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c6d88-2498-4b51-8109-586de62fef8e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.694659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1085/2150] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:50:25.698527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246aa3c-916a-4da1-a558-33e3fc683a77 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.708474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b246aa3c-916a-4da1-a558-33e3fc683a77 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.713319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f952-676c-44f0-bc07-f0a0aa822351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.713994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f952-676c-44f0-bc07-f0a0aa822351 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.714275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f952-676c-44f0-bc07-f0a0aa822351 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.714552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c04f952-676c-44f0-bc07-f0a0aa822351 admin admin] PATH_INFO: `/v3/projects/5babb42053d243baa626571b0813ffb2/users/d33ddbf2fad24e56ac4dd42c4b4c5423/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.729940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04f952-676c-44f0-bc07-f0a0aa822351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5babb42053d243baa626571b0813ffb2, user_id=d33ddbf2fad24e56ac4dd42c4b4c5423, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.732590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c04f952-676c-44f0-bc07-f0a0aa822351 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.745716 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1066/2151] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:25 2022] PUT /identity/v3/projects/5babb42053d243baa626571b0813ffb2/users/d33ddbf2fad24e56ac4dd42c4b4c5423/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:25.749748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c6d88-2498-4b51-8109-586de62fef8e admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.760574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c6d88-2498-4b51-8109-586de62fef8e admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.816539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c02995-665c-4288-8b58-738fb0dbe568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.817146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c02995-665c-4288-8b58-738fb0dbe568 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.817453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c02995-665c-4288-8b58-738fb0dbe568 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.817732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c02995-665c-4288-8b58-738fb0dbe568 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.818422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c02995-665c-4288-8b58-738fb0dbe568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.820003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c02995-665c-4288-8b58-738fb0dbe568 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.829689 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1086/2152] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:25.833884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f952-676c-44f0-bc07-f0a0aa822351 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:25.844242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c04f952-676c-44f0-bc07-f0a0aa822351 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:25.849023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9a42-5642-4207-87e8-283126276bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:25.849720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9a42-5642-4207-87e8-283126276bef admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.850002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9a42-5642-4207-87e8-283126276bef admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.850305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9a42-5642-4207-87e8-283126276bef admin admin] PATH_INFO: `/v3/projects/5babb42053d243baa626571b0813ffb2/users/d33ddbf2fad24e56ac4dd42c4b4c5423/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.852210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c9a42-5642-4207-87e8-283126276bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=5babb42053d243baa626571b0813ffb2, user_id=d33ddbf2fad24e56ac4dd42c4b4c5423, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:25.854976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c9a42-5642-4207-87e8-283126276bef admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:25.866357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1067/2153] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:25 2022] PUT /identity/v3/projects/5babb42053d243baa626571b0813ffb2/users/d33ddbf2fad24e56ac4dd42c4b4c5423/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:25.877885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7783cc-a446-4787-b500-eda10d3b8610 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:25.878177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7783cc-a446-4787-b500-eda10d3b8610 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:25.878512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7783cc-a446-4787-b500-eda10d3b8610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:25.906490 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0d7783cc-a446-4787-b500-eda10d3b8610 None None] MFA Rules not processed for user `d33ddbf2fad24e56ac4dd42c4b4c5423`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:25.907788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0d7783cc-a446-4787-b500-eda10d3b8610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:25.922387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:25.996261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1087/2154] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:26.009313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9a42-5642-4207-87e8-283126276bef admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:26.011211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-976c9a42-5642-4207-87e8-283126276bef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:26.082569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9a42-5642-4207-87e8-283126276bef admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:26.086857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e5bab3-f67a-40b3-9fff-0b58985e0476 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:26.087541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5bab3-f67a-40b3-9fff-0b58985e0476 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:26.087816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5bab3-f67a-40b3-9fff-0b58985e0476 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:26.088090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e5bab3-f67a-40b3-9fff-0b58985e0476 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:26.154145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5bab3-f67a-40b3-9fff-0b58985e0476 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:26.155501 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e5bab3-f67a-40b3-9fff-0b58985e0476 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:26.164663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1068/2155] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:27.034932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7783cc-a446-4787-b500-eda10d3b8610 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:27.036380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0d7783cc-a446-4787-b500-eda10d3b8610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:27.109740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7783cc-a446-4787-b500-eda10d3b8610 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:27.114955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:27.115621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:27.115901 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:27.116176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] PATH_INFO: `/v3/users/132e93f8b39d4f2981c4bd97db719f69` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:27.117299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=132e93f8b39d4f2981c4bd97db719f69)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:27.119250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:27.167608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132e93f8b39d4f2981c4bd97db719f69'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.175695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132e93f8b39d4f2981c4bd97db719f69'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.176335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132e93f8b39d4f2981c4bd97db719f69'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.191584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132e93f8b39d4f2981c4bd97db719f69'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.206708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132e93f8b39d4f2981c4bd97db719f69'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.214082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1088/2156] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:27 2022] DELETE /identity/v3/users/132e93f8b39d4f2981c4bd97db719f69 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:27.218485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960781-d861-409d-9f6b-28cc7feb8500 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:27.218974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960781-d861-409d-9f6b-28cc7feb8500 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:27.219180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960781-d861-409d-9f6b-28cc7feb8500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:27.233714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:27.240086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7b960781-d861-409d-9f6b-28cc7feb8500 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:27.242156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7b960781-d861-409d-9f6b-28cc7feb8500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:27.324974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1069/2157] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:27.334721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:27.336473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:27.371628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:27.400344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531c2604-516d-4b81-b53a-6da60cc141fe admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:27.404255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8035cf8-600b-4215-8796-62c03130c355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:27.404871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8035cf8-600b-4215-8796-62c03130c355 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:27.405154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8035cf8-600b-4215-8796-62c03130c355 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:27.405444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8035cf8-600b-4215-8796-62c03130c355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:27.420761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8035cf8-600b-4215-8796-62c03130c355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:27.422601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8035cf8-600b-4215-8796-62c03130c355 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:27.437996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1089/2158] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:27.760858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b960781-d861-409d-9f6b-28cc7feb8500 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:27.762661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7b960781-d861-409d-9f6b-28cc7feb8500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:27.782384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b960781-d861-409d-9f6b-28cc7feb8500 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:27.791484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:27.792280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:27.792566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:27.793215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] PATH_INFO: `/v3/projects/55e398625838487eb27257cfe4fbd5f3` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:27.794561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=55e398625838487eb27257cfe4fbd5f3)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:27.796479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:27.841266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8035cf8-600b-4215-8796-62c03130c355 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:27.843369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e8035cf8-600b-4215-8796-62c03130c355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:27.855588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55e398625838487eb27257cfe4fbd5f3', 'request_id': 'req-21ce3d14-2dec-4825-9569-ab6edadd3b3e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.865924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55e398625838487eb27257cfe4fbd5f3', 'request_id': 'req-21ce3d14-2dec-4825-9569-ab6edadd3b3e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.873667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55e398625838487eb27257cfe4fbd5f3', 'request_id': 'req-21ce3d14-2dec-4825-9569-ab6edadd3b3e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.885699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] The token cache is being invalidate because project 55e398625838487eb27257cfe4fbd5f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:27.885996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.886651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21ce3d14-2dec-4825-9569-ab6edadd3b3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:27.888205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1070/2159] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:27 2022] DELETE /identity/v3/projects/55e398625838487eb27257cfe4fbd5f3 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:27.894411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7f887-d239-4213-816e-afc94017f005 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:27.894774 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7f887-d239-4213-816e-afc94017f005 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:27.895235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7f887-d239-4213-816e-afc94017f005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:27.914123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8035cf8-600b-4215-8796-62c03130c355 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:27.931537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-87f7f887-d239-4213-816e-afc94017f005 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:27.932898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-87f7f887-d239-4213-816e-afc94017f005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:27.986896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb004337-5b8f-4a16-a0b0-212bdcd575b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:27.987650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb004337-5b8f-4a16-a0b0-212bdcd575b0 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:27.988060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb004337-5b8f-4a16-a0b0-212bdcd575b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:27.988329 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb004337-5b8f-4a16-a0b0-212bdcd575b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:27.990828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-bb004337-5b8f-4a16-a0b0-212bdcd575b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:28.006384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1071/2160] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:50:28.014364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5833-d1eb-45fb-9d8d-aa16c63b0ba5 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.014653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5833-d1eb-45fb-9d8d-aa16c63b0ba5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.014931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d5833-d1eb-45fb-9d8d-aa16c63b0ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.035970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a65d5833-d1eb-45fb-9d8d-aa16c63b0ba5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:28.037155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a65d5833-d1eb-45fb-9d8d-aa16c63b0ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:28.045575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1072/2161] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:50:28.049609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d5833-d1eb-45fb-9d8d-aa16c63b0ba5 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:28.058375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d5833-d1eb-45fb-9d8d-aa16c63b0ba5 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:28.058551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb004337-5b8f-4a16-a0b0-212bdcd575b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:28.060077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb004337-5b8f-4a16-a0b0-212bdcd575b0 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:28.063217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8d50d-2bbb-4c9a-8e26-8be905168eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:28.063973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8d50d-2bbb-4c9a-8e26-8be905168eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.064250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8d50d-2bbb-4c9a-8e26-8be905168eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.064893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c8d50d-2bbb-4c9a-8e26-8be905168eb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.065243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8d50d-2bbb-4c9a-8e26-8be905168eb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:50:28.065610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8d50d-2bbb-4c9a-8e26-8be905168eb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:28.067213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c8d50d-2bbb-4c9a-8e26-8be905168eb8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:28.069274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1090/2162] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:50:28.086289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1073/2163] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:50:28.087915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb004337-5b8f-4a16-a0b0-212bdcd575b0 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:28.100398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb004337-5b8f-4a16-a0b0-212bdcd575b0 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:28.105310 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04904b9-d542-4c4e-90ae-8e3f6c802c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:28.106055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04904b9-d542-4c4e-90ae-8e3f6c802c05 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.106399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04904b9-d542-4c4e-90ae-8e3f6c802c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.106739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04904b9-d542-4c4e-90ae-8e3f6c802c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.107527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04904b9-d542-4c4e-90ae-8e3f6c802c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:28.109556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04904b9-d542-4c4e-90ae-8e3f6c802c05 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:28.139291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1091/2164] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:28 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:28.140274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8d50d-2bbb-4c9a-8e26-8be905168eb8 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:28.151358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c8d50d-2bbb-4c9a-8e26-8be905168eb8 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:28.160086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:28.220235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d14cf-1b06-4bed-8d16-da5a23bf3769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:28.220889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d14cf-1b06-4bed-8d16-da5a23bf3769 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.221516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d14cf-1b06-4bed-8d16-da5a23bf3769 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.221801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d14cf-1b06-4bed-8d16-da5a23bf3769 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.222571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d14cf-1b06-4bed-8d16-da5a23bf3769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:28.225332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d14cf-1b06-4bed-8d16-da5a23bf3769 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:28.254644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1074/2165] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:28 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:50:28.255908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04904b9-d542-4c4e-90ae-8e3f6c802c05 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:28.266075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04904b9-d542-4c4e-90ae-8e3f6c802c05 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:28.270662 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad20e0f-ac5f-47b8-b282-dcc58a4e9308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:28.271256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad20e0f-ac5f-47b8-b282-dcc58a4e9308 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.271531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad20e0f-ac5f-47b8-b282-dcc58a4e9308 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.271811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad20e0f-ac5f-47b8-b282-dcc58a4e9308 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.272482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad20e0f-ac5f-47b8-b282-dcc58a4e9308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:28.274109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad20e0f-ac5f-47b8-b282-dcc58a4e9308 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:28.285447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1092/2166] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:28.289082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d14cf-1b06-4bed-8d16-da5a23bf3769 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:28.305306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d14cf-1b06-4bed-8d16-da5a23bf3769 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:28.313875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bfb556-99a4-4272-925c-c893ab1dfee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:28.314522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfb556-99a4-4272-925c-c893ab1dfee7 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.314801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfb556-99a4-4272-925c-c893ab1dfee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.315078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bfb556-99a4-4272-925c-c893ab1dfee7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.315724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfb556-99a4-4272-925c-c893ab1dfee7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:28.317357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bfb556-99a4-4272-925c-c893ab1dfee7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:28.332018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1075/2167] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:28 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:50:28.336185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad20e0f-ac5f-47b8-b282-dcc58a4e9308 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:28.347801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad20e0f-ac5f-47b8-b282-dcc58a4e9308 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:28.352569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642102f-48cc-476f-baea-2da5d47b62cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:28.353294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642102f-48cc-476f-baea-2da5d47b62cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.353651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642102f-48cc-476f-baea-2da5d47b62cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.353935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d642102f-48cc-476f-baea-2da5d47b62cb admin admin] PATH_INFO: `/v3/projects/a55bacccc6064fd4bc3e8cb76fe1b502/users/c00ec99ee3fb48b485e5bac4a31b2841/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.368284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:28.377082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642102f-48cc-476f-baea-2da5d47b62cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55bacccc6064fd4bc3e8cb76fe1b502, user_id=c00ec99ee3fb48b485e5bac4a31b2841, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:28.380138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d642102f-48cc-476f-baea-2da5d47b62cb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:28.396348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1093/2168] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:28 2022] PUT /identity/v3/projects/a55bacccc6064fd4bc3e8cb76fe1b502/users/c00ec99ee3fb48b485e5bac4a31b2841/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:50:28.402125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eb0a3-f32d-4c90-9a1d-24720de01532 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.402125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eb0a3-f32d-4c90-9a1d-24720de01532 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.402535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3eb0a3-f32d-4c90-9a1d-24720de01532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.434682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ff3eb0a3-f32d-4c90-9a1d-24720de01532 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:28.437500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ff3eb0a3-f32d-4c90-9a1d-24720de01532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:28.530235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1076/2169] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:50:28.543017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642102f-48cc-476f-baea-2da5d47b62cb admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:28.545365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d642102f-48cc-476f-baea-2da5d47b62cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:28.648365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d642102f-48cc-476f-baea-2da5d47b62cb admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:28.665038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b61a9-5bdd-4455-8b51-88d5138032f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:28.666258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b61a9-5bdd-4455-8b51-88d5138032f7 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.666546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b61a9-5bdd-4455-8b51-88d5138032f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.666877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b61a9-5bdd-4455-8b51-88d5138032f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.684202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b61a9-5bdd-4455-8b51-88d5138032f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:28.687779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b61a9-5bdd-4455-8b51-88d5138032f7 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:28.717274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1094/2170] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:28.756087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eb0a3-f32d-4c90-9a1d-24720de01532 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:28.757630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ff3eb0a3-f32d-4c90-9a1d-24720de01532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:28.843316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3eb0a3-f32d-4c90-9a1d-24720de01532 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:28.847110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9731a3aa-50d3-4f0f-b106-eee873470a9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:28.847732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731a3aa-50d3-4f0f-b106-eee873470a9b service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:28.848013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731a3aa-50d3-4f0f-b106-eee873470a9b service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:28.848290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9731a3aa-50d3-4f0f-b106-eee873470a9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:28.853252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9731a3aa-50d3-4f0f-b106-eee873470a9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:28.910007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:28.931108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731a3aa-50d3-4f0f-b106-eee873470a9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:28.932842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9731a3aa-50d3-4f0f-b106-eee873470a9b service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:28.943921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1077/2171] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:33.213314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b61a9-5bdd-4455-8b51-88d5138032f7 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:33.214889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-890b61a9-5bdd-4455-8b51-88d5138032f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:33.231817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b61a9-5bdd-4455-8b51-88d5138032f7 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:33.240667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:33.242051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:33.242432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:33.242806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] PATH_INFO: `/v3/users/1a18c34d807c46448d0cd866ef1c8758` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:33.244043 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a18c34d807c46448d0cd866ef1c8758)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:33.246249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:33.306516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a18c34d807c46448d0cd866ef1c8758'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:33.316705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a18c34d807c46448d0cd866ef1c8758'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:33.317780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a18c34d807c46448d0cd866ef1c8758'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:33.341841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a18c34d807c46448d0cd866ef1c8758'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:33.372203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a18c34d807c46448d0cd866ef1c8758'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:33.382916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1095/2172] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:33 2022] DELETE /identity/v3/users/1a18c34d807c46448d0cd866ef1c8758 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:33.387433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaeb1b-a886-43e5-b0c6-dd8a055456c9 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:33.387872 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaeb1b-a886-43e5-b0c6-dd8a055456c9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:33.388035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1aaeb1b-a886-43e5-b0c6-dd8a055456c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:33.449989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a1aaeb1b-a886-43e5-b0c6-dd8a055456c9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:33.451310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a1aaeb1b-a886-43e5-b0c6-dd8a055456c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:33.579446 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1078/2173] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:33.590539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:33.592154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:33.671838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605eca89-1ebd-49a6-86d8-3f9862a5ddf1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:33.681794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0331039-37de-46d6-ac94-55d24ddcfbd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:33.682429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0331039-37de-46d6-ac94-55d24ddcfbd2 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:33.682709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0331039-37de-46d6-ac94-55d24ddcfbd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:33.682981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0331039-37de-46d6-ac94-55d24ddcfbd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:33.724578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0331039-37de-46d6-ac94-55d24ddcfbd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:33.726078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0331039-37de-46d6-ac94-55d24ddcfbd2 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:33.738640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1096/2174] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:50:34.136769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaeb1b-a886-43e5-b0c6-dd8a055456c9 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:34.138508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a1aaeb1b-a886-43e5-b0c6-dd8a055456c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:34.169753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1aaeb1b-a886-43e5-b0c6-dd8a055456c9 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:34.176739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:34.177667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:34.178116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:34.178486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] PATH_INFO: `/v3/projects/5fb1fd2d3639471d84129c8134e23b3c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:34.180097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fb1fd2d3639471d84129c8134e23b3c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:34.182432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:34.311071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fb1fd2d3639471d84129c8134e23b3c', 'request_id': 'req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.327974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fb1fd2d3639471d84129c8134e23b3c', 'request_id': 'req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.338981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fb1fd2d3639471d84129c8134e23b3c', 'request_id': 'req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.376468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] The token cache is being invalidate because project 5fb1fd2d3639471d84129c8134e23b3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:34.377428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.378373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-4e55e1e5-e76f-49b1-a2d3-f90dd436876c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.387917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1079/2175] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:34 2022] DELETE /identity/v3/projects/5fb1fd2d3639471d84129c8134e23b3c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:34.389159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0331039-37de-46d6-ac94-55d24ddcfbd2 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:34.397981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:34.457575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0331039-37de-46d6-ac94-55d24ddcfbd2 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:34.610095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:34.610723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:34.611356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:34.611643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] PATH_INFO: `/v3/users/ad7dfac6d903455e994c763613c3374b` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:34.612888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad7dfac6d903455e994c763613c3374b)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:34.615258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:34.682716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad7dfac6d903455e994c763613c3374b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.697015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad7dfac6d903455e994c763613c3374b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.697896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad7dfac6d903455e994c763613c3374b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.707956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad7dfac6d903455e994c763613c3374b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.731904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad7dfac6d903455e994c763613c3374b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:34.759431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1097/2176] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:34 2022] DELETE /identity/v3/users/ad7dfac6d903455e994c763613c3374b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:34.772345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a565f-2f7f-4bed-87df-bb78b4df159b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:34.773155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a565f-2f7f-4bed-87df-bb78b4df159b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:34.773612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a565f-2f7f-4bed-87df-bb78b4df159b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:34.824399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-559a565f-2f7f-4bed-87df-bb78b4df159b None None] MFA Rules not processed for user `c00ec99ee3fb48b485e5bac4a31b2841`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:34.825792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-559a565f-2f7f-4bed-87df-bb78b4df159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:34.954970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:34.992001 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1080/2177] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:34.997345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:34.999626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:35.119155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932bde43-8dc3-4e97-92e9-427f9822d263 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:35.126790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985920ca-8a48-43b4-b462-c3e5f5d98b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:35.129244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985920ca-8a48-43b4-b462-c3e5f5d98b09 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:35.129671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985920ca-8a48-43b4-b462-c3e5f5d98b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:35.130078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985920ca-8a48-43b4-b462-c3e5f5d98b09 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:35.130850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985920ca-8a48-43b4-b462-c3e5f5d98b09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:35.133146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985920ca-8a48-43b4-b462-c3e5f5d98b09 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:35.142080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a565f-2f7f-4bed-87df-bb78b4df159b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:35.143960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-559a565f-2f7f-4bed-87df-bb78b4df159b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:35.172610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a565f-2f7f-4bed-87df-bb78b4df159b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:35.190161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:35.190161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:35.190161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:35.190161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] PATH_INFO: `/v3/projects/a7a65362d68b4664850f58a20e5f0779` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:35.190584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7a65362d68b4664850f58a20e5f0779)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:35.190584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:35.203799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1098/2178] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:50:34 2022] POST /identity/v3/projects => generated 385 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:35.204610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985920ca-8a48-43b4-b462-c3e5f5d98b09 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:35.218013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:35.272032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7a65362d68b4664850f58a20e5f0779', 'request_id': 'req-7271ab17-22e9-40d9-8c66-9418bd331393'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.287125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7a65362d68b4664850f58a20e5f0779', 'request_id': 'req-7271ab17-22e9-40d9-8c66-9418bd331393'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.302569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7a65362d68b4664850f58a20e5f0779', 'request_id': 'req-7271ab17-22e9-40d9-8c66-9418bd331393'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.317182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985920ca-8a48-43b4-b462-c3e5f5d98b09 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:35.336852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] The token cache is being invalidate because project a7a65362d68b4664850f58a20e5f0779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:35.337155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.338125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.340306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1081/2179] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:35 2022] DELETE /identity/v3/projects/a7a65362d68b4664850f58a20e5f0779 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:35.345142 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:35.348583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:35.492082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7271ab17-22e9-40d9-8c66-9418bd331393 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:35.499771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f9202-9546-4f0a-b93d-5397dee0e0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:35.501039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9202-9546-4f0a-b93d-5397dee0e0c5 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:35.501320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9202-9546-4f0a-b93d-5397dee0e0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:35.501687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920f9202-9546-4f0a-b93d-5397dee0e0c5 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:35.502385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f9202-9546-4f0a-b93d-5397dee0e0c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:35.504667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920f9202-9546-4f0a-b93d-5397dee0e0c5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:35.505685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:35.506326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:35.506600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:35.506868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] PATH_INFO: `/v3/users/d33ddbf2fad24e56ac4dd42c4b4c5423` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:35.508117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d33ddbf2fad24e56ac4dd42c4b4c5423)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:35.510178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:35.537515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1099/2180] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:50:35 2022] POST /identity/v3/users => generated 299 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:50:35.541355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f9202-9546-4f0a-b93d-5397dee0e0c5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:35.545748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-920f9202-9546-4f0a-b93d-5397dee0e0c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:35.567023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920f9202-9546-4f0a-b93d-5397dee0e0c5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:35.574223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135118e1-7bf1-472e-ba5e-c73ea13bf62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:35.575000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135118e1-7bf1-472e-ba5e-c73ea13bf62a admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:35.575307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135118e1-7bf1-472e-ba5e-c73ea13bf62a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:35.575735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135118e1-7bf1-472e-ba5e-c73ea13bf62a admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:35.576435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135118e1-7bf1-472e-ba5e-c73ea13bf62a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:35.579437 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135118e1-7bf1-472e-ba5e-c73ea13bf62a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:35.596809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1100/2181] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:50:35.603663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135118e1-7bf1-472e-ba5e-c73ea13bf62a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:35.611102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd33ddbf2fad24e56ac4dd42c4b4c5423'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.616995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135118e1-7bf1-472e-ba5e-c73ea13bf62a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:35.621597 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd33ddbf2fad24e56ac4dd42c4b4c5423'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.622633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd33ddbf2fad24e56ac4dd42c4b4c5423'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.626564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115265ef-e1df-47fe-9c5f-e92a9641179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:35.627703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115265ef-e1df-47fe-9c5f-e92a9641179c admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:35.627995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115265ef-e1df-47fe-9c5f-e92a9641179c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:35.628282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115265ef-e1df-47fe-9c5f-e92a9641179c admin admin] PATH_INFO: `/v3/projects/b88b1d2bfa6e43f2b2a775c33519f417/users/d470e88ab32c404abab5217b34828d47/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:35.646617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd33ddbf2fad24e56ac4dd42c4b4c5423'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.653626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:35.654244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115265ef-e1df-47fe-9c5f-e92a9641179c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88b1d2bfa6e43f2b2a775c33519f417, user_id=d470e88ab32c404abab5217b34828d47, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:35.656078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd33ddbf2fad24e56ac4dd42c4b4c5423'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:35.659653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115265ef-e1df-47fe-9c5f-e92a9641179c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:35.673226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1082/2182] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:50:35 2022] DELETE /identity/v3/users/d33ddbf2fad24e56ac4dd42c4b4c5423 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:50:35.684182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1101/2183] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:35 2022] PUT /identity/v3/projects/b88b1d2bfa6e43f2b2a775c33519f417/users/d470e88ab32c404abab5217b34828d47/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:35.687194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:35.688685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:35.766747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a349c3-cfc9-4268-bb97-90048bf421c7 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:35.842774 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4c930-59ad-4289-a415-1d206c7cb8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:35.844102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4c930-59ad-4289-a415-1d206c7cb8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:35.844598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4c930-59ad-4289-a415-1d206c7cb8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:35.846034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4c930-59ad-4289-a415-1d206c7cb8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:35.846990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4c930-59ad-4289-a415-1d206c7cb8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:35.849474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b4c930-59ad-4289-a415-1d206c7cb8a5 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:35.876223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1083/2184] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:50:35.880921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115265ef-e1df-47fe-9c5f-e92a9641179c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:35.893838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115265ef-e1df-47fe-9c5f-e92a9641179c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:35.899508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea787a83-8b10-4279-b389-37389e09278d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:35.899825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787a83-8b10-4279-b389-37389e09278d admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:35.900102 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787a83-8b10-4279-b389-37389e09278d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:35.900371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea787a83-8b10-4279-b389-37389e09278d admin admin] PATH_INFO: `/v3/projects/b88b1d2bfa6e43f2b2a775c33519f417/users/d470e88ab32c404abab5217b34828d47/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:35.902314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea787a83-8b10-4279-b389-37389e09278d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b88b1d2bfa6e43f2b2a775c33519f417, user_id=d470e88ab32c404abab5217b34828d47, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:35.905027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea787a83-8b10-4279-b389-37389e09278d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:35.919708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1102/2185] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:50:35 2022] PUT /identity/v3/projects/b88b1d2bfa6e43f2b2a775c33519f417/users/d470e88ab32c404abab5217b34828d47/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:50:36.267952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4c930-59ad-4289-a415-1d206c7cb8a5 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:36.269974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a9b4c930-59ad-4289-a415-1d206c7cb8a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:36.298153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4c930-59ad-4289-a415-1d206c7cb8a5 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:36.439048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:36.442253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:36.442532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:36.443019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] PATH_INFO: `/v3/projects/5babb42053d243baa626571b0813ffb2` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:36.448301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5babb42053d243baa626571b0813ffb2)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:36.454149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:36.538613 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:36.548931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5babb42053d243baa626571b0813ffb2', 'request_id': 'req-42462a03-2001-4b9a-8bbc-ce61360f9caf'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:36.560060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5babb42053d243baa626571b0813ffb2', 'request_id': 'req-42462a03-2001-4b9a-8bbc-ce61360f9caf'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:36.607443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5babb42053d243baa626571b0813ffb2', 'request_id': 'req-42462a03-2001-4b9a-8bbc-ce61360f9caf'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:36.638617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] The token cache is being invalidate because project 5babb42053d243baa626571b0813ffb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:50:36.638934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:36.642999 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-42462a03-2001-4b9a-8bbc-ce61360f9caf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:50:36.648792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1084/2186] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:50:36 2022] DELETE /identity/v3/projects/5babb42053d243baa626571b0813ffb2 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:50:36.700676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197f22d-5aee-46d5-b777-8bef81aa95d6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:36.701143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197f22d-5aee-46d5-b777-8bef81aa95d6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:36.701238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b197f22d-5aee-46d5-b777-8bef81aa95d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:36.744768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b197f22d-5aee-46d5-b777-8bef81aa95d6 None None] MFA Rules not processed for user `55768aa930cf45a6a75939c56c12c3b6`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:36.747937 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b197f22d-5aee-46d5-b777-8bef81aa95d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:36.867055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1103/2187] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:42.043133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a25542-6f51-4cb9-8676-3d8bc79e7f3a None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:42.043629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a25542-6f51-4cb9-8676-3d8bc79e7f3a None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:42.043629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a25542-6f51-4cb9-8676-3d8bc79e7f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:42.063428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-c3a25542-6f51-4cb9-8676-3d8bc79e7f3a None None] MFA Rules not processed for user `e33cf9baa72248739f58cb3a3d7d078b`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:42.065159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c3a25542-6f51-4cb9-8676-3d8bc79e7f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:42.161452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1085/2188] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:44.941654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc575c5-8d2b-45f7-90d0-6ec8f1553926 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:44.942530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc575c5-8d2b-45f7-90d0-6ec8f1553926 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:44.943050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc575c5-8d2b-45f7-90d0-6ec8f1553926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:44.953666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:44.983145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6fc575c5-8d2b-45f7-90d0-6ec8f1553926 None None] MFA Rules not processed for user `d470e88ab32c404abab5217b34828d47`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:44.984413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6fc575c5-8d2b-45f7-90d0-6ec8f1553926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:45.057775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1104/2189] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:45.070802 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a25542-6f51-4cb9-8676-3d8bc79e7f3a None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:45.072218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c3a25542-6f51-4cb9-8676-3d8bc79e7f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:45.131129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a25542-6f51-4cb9-8676-3d8bc79e7f3a None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:45.140374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babdd851ad7b4ba99b5746d8480bc082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:45.141451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:45.142538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:45.142985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:45.144852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:45.223590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:45.227382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:45.243763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1086/2190] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:45.444178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aaf3d-03e7-4874-bad5-4f4746f858ae None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:45.444677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aaf3d-03e7-4874-bad5-4f4746f858ae None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:45.445083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aaf3d-03e7-4874-bad5-4f4746f858ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:45.494713 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7d5aaf3d-03e7-4874-bad5-4f4746f858ae None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:45.496281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7d5aaf3d-03e7-4874-bad5-4f4746f858ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:45.602127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1105/2191] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:50:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:45.653725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:45.658863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:45.727393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:45.800823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c218affa-33e4-4215-8b71-41a9958a6ac6 service glance] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:45.807770 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e121cc-8ead-409c-b200-b2147a7fac88 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:45.808604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e121cc-8ead-409c-b200-b2147a7fac88 service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:45.808907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e121cc-8ead-409c-b200-b2147a7fac88 service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:45.809196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e121cc-8ead-409c-b200-b2147a7fac88 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:45.840385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e121cc-8ead-409c-b200-b2147a7fac88 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:45.842233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e121cc-8ead-409c-b200-b2147a7fac88 service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:45.853939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1087/2192] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:50:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:50:50.550344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27244d29-fa1a-4881-9faa-e4f7cb0354fb None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:50.550978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27244d29-fa1a-4881-9faa-e4f7cb0354fb None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:50.551128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27244d29-fa1a-4881-9faa-e4f7cb0354fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:50.592485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-27244d29-fa1a-4881-9faa-e4f7cb0354fb None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:50.593896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-27244d29-fa1a-4881-9faa-e4f7cb0354fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:50.729967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1106/2193] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:50:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:50.764828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e121cc-8ead-409c-b200-b2147a7fac88 service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:50.766465 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-77e121cc-8ead-409c-b200-b2147a7fac88 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:50.887451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e121cc-8ead-409c-b200-b2147a7fac88 service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:50.894917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ca7b1-27f4-4a87-a7ca-9b7c97a507d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:50.895711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ca7b1-27f4-4a87-a7ca-9b7c97a507d0 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:50.896081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ca7b1-27f4-4a87-a7ca-9b7c97a507d0 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:50.896719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84ca7b1-27f4-4a87-a7ca-9b7c97a507d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:50.905809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ca7b1-27f4-4a87-a7ca-9b7c97a507d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:50.908687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84ca7b1-27f4-4a87-a7ca-9b7c97a507d0 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:50.937838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1088/2194] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:55.780035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e8360-01b8-4381-b891-b69aa769511a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:55.780537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e8360-01b8-4381-b891-b69aa769511a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:55.780655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e8360-01b8-4381-b891-b69aa769511a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:55.802178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a24e8360-01b8-4381-b891-b69aa769511a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:55.803743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a24e8360-01b8-4381-b891-b69aa769511a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:55.812916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1107/2195] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:55.831643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ca7b1-27f4-4a87-a7ca-9b7c97a507d0 service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:55.845622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84ca7b1-27f4-4a87-a7ca-9b7c97a507d0 service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:55.851737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61c0c28-e2b4-4613-ba53-df9ea5863673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:55.852477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c0c28-e2b4-4613-ba53-df9ea5863673 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:55.852878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c0c28-e2b4-4613-ba53-df9ea5863673 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:55.853254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61c0c28-e2b4-4613-ba53-df9ea5863673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:55.866290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c0c28-e2b4-4613-ba53-df9ea5863673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:55.867946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61c0c28-e2b4-4613-ba53-df9ea5863673 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:55.893145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1089/2196] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:50:58.069466 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157e24-4abc-4aab-a1d2-a773c6598339 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:58.070105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157e24-4abc-4aab-a1d2-a773c6598339 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:58.070105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1157e24-4abc-4aab-a1d2-a773c6598339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:58.126283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b1157e24-4abc-4aab-a1d2-a773c6598339 None None] MFA Rules not processed for user `aac4f2beca334a7f8c62924b5d7e4fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:58.126283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b1157e24-4abc-4aab-a1d2-a773c6598339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:58.160737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:50:58.249755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1108/2197] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:58 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:59.150209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989ffa9-619d-46d2-9807-10642664c05e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:59.150772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989ffa9-619d-46d2-9807-10642664c05e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:59.150772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f989ffa9-619d-46d2-9807-10642664c05e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:59.175088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f989ffa9-619d-46d2-9807-10642664c05e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:59.177806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f989ffa9-619d-46d2-9807-10642664c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:59.197637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1090/2198] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:50:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:50:59.252935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70a4c5-dd67-4b56-982a-a70d108426ba None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:59.256943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70a4c5-dd67-4b56-982a-a70d108426ba None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:59.257230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70a4c5-dd67-4b56-982a-a70d108426ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:59.260792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989ffa9-619d-46d2-9807-10642664c05e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:50:59.262568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f989ffa9-619d-46d2-9807-10642664c05e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:59.279557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f989ffa9-619d-46d2-9807-10642664c05e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:50:59.280622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-bf70a4c5-dd67-4b56-982a-a70d108426ba None None] MFA Rules not processed for user `c00ec99ee3fb48b485e5bac4a31b2841`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:50:59.282596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-bf70a4c5-dd67-4b56-982a-a70d108426ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:50:59.286924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8857e-660b-45b5-99c0-f5659b9f4c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:50:59.287964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8857e-660b-45b5-99c0-f5659b9f4c98 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:50:59.288516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8857e-660b-45b5-99c0-f5659b9f4c98 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:50:59.288972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8857e-660b-45b5-99c0-f5659b9f4c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:50:59.290920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1109/2199] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:50:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:50:59.299775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8857e-660b-45b5-99c0-f5659b9f4c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:50:59.301456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e8857e-660b-45b5-99c0-f5659b9f4c98 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:50:59.314093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1091/2200] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:51:01.307046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3116cf-e450-4939-aaf6-75120fa95189 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:01.307924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3116cf-e450-4939-aaf6-75120fa95189 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:01.308510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3116cf-e450-4939-aaf6-75120fa95189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:01.344870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-be3116cf-e450-4939-aaf6-75120fa95189 None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:01.346797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-be3116cf-e450-4939-aaf6-75120fa95189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:01.356846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1110/2201] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:51:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:01.373181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8857e-660b-45b5-99c0-f5659b9f4c98 service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:01.385622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8857e-660b-45b5-99c0-f5659b9f4c98 service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:01.390656 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ee52b-3a72-4c82-8ccb-a33d2cb3cc82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:01.391899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ee52b-3a72-4c82-8ccb-a33d2cb3cc82 service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:01.392185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ee52b-3a72-4c82-8ccb-a33d2cb3cc82 service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:01.392462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4ee52b-3a72-4c82-8ccb-a33d2cb3cc82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:01.400320 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ee52b-3a72-4c82-8ccb-a33d2cb3cc82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:01.401954 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4ee52b-3a72-4c82-8ccb-a33d2cb3cc82 service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:01.410244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1092/2202] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:51:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:51:03.421650 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323694e-c7b1-41e4-8697-773fb5b057f8 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:03.422669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323694e-c7b1-41e4-8697-773fb5b057f8 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:03.423145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323694e-c7b1-41e4-8697-773fb5b057f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:03.448500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e323694e-c7b1-41e4-8697-773fb5b057f8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:03.450175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e323694e-c7b1-41e4-8697-773fb5b057f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:03.460579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1111/2203] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:03.480377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ee52b-3a72-4c82-8ccb-a33d2cb3cc82 service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:03.494655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4ee52b-3a72-4c82-8ccb-a33d2cb3cc82 service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:03.502114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923f7d-0233-44fe-9ecf-b5609c5e4157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:03.503148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923f7d-0233-44fe-9ecf-b5609c5e4157 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:03.503428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923f7d-0233-44fe-9ecf-b5609c5e4157 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:03.503873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27923f7d-0233-44fe-9ecf-b5609c5e4157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:03.514084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27923f7d-0233-44fe-9ecf-b5609c5e4157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:03.516032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27923f7d-0233-44fe-9ecf-b5609c5e4157 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:03.530324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1093/2204] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:51:08.804205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76f57-6914-4461-bf23-cc724dc332a5 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:08.805140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76f57-6914-4461-bf23-cc724dc332a5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:08.805611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a76f57-6914-4461-bf23-cc724dc332a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:08.835756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-69a76f57-6914-4461-bf23-cc724dc332a5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:08.837450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-69a76f57-6914-4461-bf23-cc724dc332a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:08.852035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1112/2205] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:51:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:09.133810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923f7d-0233-44fe-9ecf-b5609c5e4157 service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:09.148476 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27923f7d-0233-44fe-9ecf-b5609c5e4157 service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:09.169565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e12168-0317-41d0-aa78-a27d68fb7092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:09.175770 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e12168-0317-41d0-aa78-a27d68fb7092 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:09.176071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e12168-0317-41d0-aa78-a27d68fb7092 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:09.176352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e12168-0317-41d0-aa78-a27d68fb7092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:09.199584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e12168-0317-41d0-aa78-a27d68fb7092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:09.201558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e12168-0317-41d0-aa78-a27d68fb7092 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:09.225492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1094/2206] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:51:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:51:10.877544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ce2e8-055f-49b7-8c60-a236bd8c3d84 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:10.878080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ce2e8-055f-49b7-8c60-a236bd8c3d84 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:10.878080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18ce2e8-055f-49b7-8c60-a236bd8c3d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:10.902036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e18ce2e8-055f-49b7-8c60-a236bd8c3d84 None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:10.903516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e18ce2e8-055f-49b7-8c60-a236bd8c3d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:10.913334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1113/2207] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:51:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:10.935108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e12168-0317-41d0-aa78-a27d68fb7092 service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:10.948547 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e12168-0317-41d0-aa78-a27d68fb7092 service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:10.955038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9ad53-e81a-48b1-bb43-d69b98c20879 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:10.955658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9ad53-e81a-48b1-bb43-d69b98c20879 service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:10.955938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9ad53-e81a-48b1-bb43-d69b98c20879 service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:10.956306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc9ad53-e81a-48b1-bb43-d69b98c20879 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:10.967216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9ad53-e81a-48b1-bb43-d69b98c20879 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:10.968814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc9ad53-e81a-48b1-bb43-d69b98c20879 service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:10.977345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1095/2208] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:51:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:51:15.315267 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618569a-c3b3-487b-afce-20582a3d5fb9 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:15.316346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618569a-c3b3-487b-afce-20582a3d5fb9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:15.316615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2618569a-c3b3-487b-afce-20582a3d5fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:15.366266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2618569a-c3b3-487b-afce-20582a3d5fb9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:15.368182 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2618569a-c3b3-487b-afce-20582a3d5fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:15.389512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1114/2209] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:51:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:15.408086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9ad53-e81a-48b1-bb43-d69b98c20879 service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:15.427206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc9ad53-e81a-48b1-bb43-d69b98c20879 service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:15.433303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce5ae-42a4-447d-8c72-397d91ebf734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:15.433962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce5ae-42a4-447d-8c72-397d91ebf734 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:15.434245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce5ae-42a4-447d-8c72-397d91ebf734 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:15.434523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bce5ae-42a4-447d-8c72-397d91ebf734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:15.444523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bce5ae-42a4-447d-8c72-397d91ebf734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:15.446174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bce5ae-42a4-447d-8c72-397d91ebf734 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:15.456369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1096/2210] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:51:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:51:25.000137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10faee0-5221-4446-a56e-b479f3751a6e None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:25.000662 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10faee0-5221-4446-a56e-b479f3751a6e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:25.000662 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10faee0-5221-4446-a56e-b479f3751a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:25.021313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-d10faee0-5221-4446-a56e-b479f3751a6e None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:25.022547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d10faee0-5221-4446-a56e-b479f3751a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:25.029682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1115/2211] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:51:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:25.042419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce5ae-42a4-447d-8c72-397d91ebf734 service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:25.048081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:51:25.054800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bce5ae-42a4-447d-8c72-397d91ebf734 service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:25.059760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e46aef-7244-4e0b-825b-3d35333bd587 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:25.060361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e46aef-7244-4e0b-825b-3d35333bd587 service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:25.060643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e46aef-7244-4e0b-825b-3d35333bd587 service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:25.060916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e46aef-7244-4e0b-825b-3d35333bd587 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:25.068929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e46aef-7244-4e0b-825b-3d35333bd587 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:25.070556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e46aef-7244-4e0b-825b-3d35333bd587 service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:25.079187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1097/2212] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:51:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:51:30.086618 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddec02-ad71-4474-96d5-7d323d51036d None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:30.087224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddec02-ad71-4474-96d5-7d323d51036d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:30.087224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ddec02-ad71-4474-96d5-7d323d51036d None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:30.088533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1116/2213] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:51:30.096703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1eae7-02fb-4f0d-9a9a-c15ea928ef1c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:30.097277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1eae7-02fb-4f0d-9a9a-c15ea928ef1c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:30.097277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1eae7-02fb-4f0d-9a9a-c15ea928ef1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:30.123553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7ce1eae7-02fb-4f0d-9a9a-c15ea928ef1c None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:30.124801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7ce1eae7-02fb-4f0d-9a9a-c15ea928ef1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:30.142039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1098/2214] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:51:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:30.153150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddec02-ad71-4474-96d5-7d323d51036d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:30.155225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-33ddec02-ad71-4474-96d5-7d323d51036d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:30.165753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=35 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:51:30.176507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ddec02-ad71-4474-96d5-7d323d51036d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:30.184790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637e6cff-68e1-4dd0-9bf6-f28cb258ad07 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babdd851ad7b4ba99b5746d8480bc082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:30.185982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6cff-68e1-4dd0-9bf6-f28cb258ad07 service glance] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:30.186886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6cff-68e1-4dd0-9bf6-f28cb258ad07 service glance] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:30.187407 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637e6cff-68e1-4dd0-9bf6-f28cb258ad07 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:30.208784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6cff-68e1-4dd0-9bf6-f28cb258ad07 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:30.210283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637e6cff-68e1-4dd0-9bf6-f28cb258ad07 service glance] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:30.225632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1117/2215] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:51:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:51:30.329923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03eb44-832e-49d1-a1a6-4652965799c7 None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:30.330516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03eb44-832e-49d1-a1a6-4652965799c7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:30.330798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff03eb44-832e-49d1-a1a6-4652965799c7 None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:30.332224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1099/2216] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:51:30.337537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944814b-f1c2-4778-89d7-caf00c8a19fa None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:30.338178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944814b-f1c2-4778-89d7-caf00c8a19fa None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:30.338525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6944814b-f1c2-4778-89d7-caf00c8a19fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:30.365196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6944814b-f1c2-4778-89d7-caf00c8a19fa None None] MFA Rules not processed for user `537d07153d3f4adfb3296c4e8e7084bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:30.366604 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6944814b-f1c2-4778-89d7-caf00c8a19fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:30.437041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1118/2217] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:51:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:30.455791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03eb44-832e-49d1-a1a6-4652965799c7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:30.457575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ff03eb44-832e-49d1-a1a6-4652965799c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:30.471821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff03eb44-832e-49d1-a1a6-4652965799c7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:30.479380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f425b1-75ae-4460-a0d4-cc1fdabb1fa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:30.480316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f425b1-75ae-4460-a0d4-cc1fdabb1fa1 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:30.480815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f425b1-75ae-4460-a0d4-cc1fdabb1fa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:30.481296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f425b1-75ae-4460-a0d4-cc1fdabb1fa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:30.490522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f425b1-75ae-4460-a0d4-cc1fdabb1fa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:30.492525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f425b1-75ae-4460-a0d4-cc1fdabb1fa1 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:30.502962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1100/2218] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:51:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:51:30.648649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446993e-b866-4eb5-8ad6-ff79e85eb3a5 None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:30.649268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446993e-b866-4eb5-8ad6-ff79e85eb3a5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:30.649776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a446993e-b866-4eb5-8ad6-ff79e85eb3a5 None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:30.651682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1119/2219] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:51:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:51:30.659654 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390880d-fb7d-4af1-a83e-5f1abb27be89 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:30.660265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390880d-fb7d-4af1-a83e-5f1abb27be89 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:30.660807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d390880d-fb7d-4af1-a83e-5f1abb27be89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:30.683052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d390880d-fb7d-4af1-a83e-5f1abb27be89 None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:30.684787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d390880d-fb7d-4af1-a83e-5f1abb27be89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:30.695490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1101/2220] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:51:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:30.707114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446993e-b866-4eb5-8ad6-ff79e85eb3a5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:30.708944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a446993e-b866-4eb5-8ad6-ff79e85eb3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:30.724862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a446993e-b866-4eb5-8ad6-ff79e85eb3a5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:30.728897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ff3685-cddb-4b0c-bb60-af906284a1c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:30.729542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff3685-cddb-4b0c-bb60-af906284a1c8 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:30.729828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff3685-cddb-4b0c-bb60-af906284a1c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:30.730106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ff3685-cddb-4b0c-bb60-af906284a1c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:30.743932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff3685-cddb-4b0c-bb60-af906284a1c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:30.745567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ff3685-cddb-4b0c-bb60-af906284a1c8 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:30.761530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1120/2221] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:51:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:51:40.011552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390880d-fb7d-4af1-a83e-5f1abb27be89 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:40.013847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d390880d-fb7d-4af1-a83e-5f1abb27be89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:40.142006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d390880d-fb7d-4af1-a83e-5f1abb27be89 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:40.149737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69c749-ee10-4fa5-839a-edf1eb1baa22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:40.150588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69c749-ee10-4fa5-839a-edf1eb1baa22 service placement] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:40.150708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69c749-ee10-4fa5-839a-edf1eb1baa22 service placement] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:40.151336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69c749-ee10-4fa5-839a-edf1eb1baa22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:40.154431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-db69c749-ee10-4fa5-839a-edf1eb1baa22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:40.173845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69c749-ee10-4fa5-839a-edf1eb1baa22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:40.174868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69c749-ee10-4fa5-839a-edf1eb1baa22 service placement] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:40.188266 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1102/2222] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:51:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:51:40.755091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=34 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:51:42.052723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fcc10-b417-422e-a1d5-0885794a625d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:42.053464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fcc10-b417-422e-a1d5-0885794a625d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:42.053464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fcc10-b417-422e-a1d5-0885794a625d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:42.097718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-419fcc10-b417-422e-a1d5-0885794a625d None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:42.099084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-419fcc10-b417-422e-a1d5-0885794a625d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:42.116242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1121/2223] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:51:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:42.140483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69c749-ee10-4fa5-839a-edf1eb1baa22 service placement] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:42.164037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69c749-ee10-4fa5-839a-edf1eb1baa22 service placement] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:42.196153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6534d39-969d-484d-bec9-6f7ac45dbd8a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:42.196797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6534d39-969d-484d-bec9-6f7ac45dbd8a service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:42.197079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6534d39-969d-484d-bec9-6f7ac45dbd8a service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:42.197357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6534d39-969d-484d-bec9-6f7ac45dbd8a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:42.226374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6534d39-969d-484d-bec9-6f7ac45dbd8a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:42.228373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6534d39-969d-484d-bec9-6f7ac45dbd8a service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:42.256205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1103/2224] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:51:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:51:44.811103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8259f-2c85-4143-91f1-30197413ffaf None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:44.811667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8259f-2c85-4143-91f1-30197413ffaf None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:44.811763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8259f-2c85-4143-91f1-30197413ffaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:44.832406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-acb8259f-2c85-4143-91f1-30197413ffaf None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:44.834035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-acb8259f-2c85-4143-91f1-30197413ffaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:44.842445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1122/2225] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 17 00:51:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:44.898228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6534d39-969d-484d-bec9-6f7ac45dbd8a service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:44.914000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6534d39-969d-484d-bec9-6f7ac45dbd8a service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:44.920277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12879cf9-0c46-4f37-b02f-819bba4ab66a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:44.921851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12879cf9-0c46-4f37-b02f-819bba4ab66a service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:44.922221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12879cf9-0c46-4f37-b02f-819bba4ab66a service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:44.922592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12879cf9-0c46-4f37-b02f-819bba4ab66a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:44.931572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12879cf9-0c46-4f37-b02f-819bba4ab66a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:44.933303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12879cf9-0c46-4f37-b02f-819bba4ab66a service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:44.942001 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1104/2226] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:51:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:51:45.846098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee31d-97cd-4b55-877b-76cd9518f2a6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:45.846706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee31d-97cd-4b55-877b-76cd9518f2a6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:45.846706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee31d-97cd-4b55-877b-76cd9518f2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:45.867181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-4eaee31d-97cd-4b55-877b-76cd9518f2a6 None None] MFA Rules not processed for user `93ec2dfa15cf4e5792b4c88a953c3a1c`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:45.868399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4eaee31d-97cd-4b55-877b-76cd9518f2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:45.932703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1123/2227] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:51:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:47.375657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12879cf9-0c46-4f37-b02f-819bba4ab66a service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:47.377343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-12879cf9-0c46-4f37-b02f-819bba4ab66a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:47.391648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12879cf9-0c46-4f37-b02f-819bba4ab66a service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:47.396455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:47.397084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:47.397367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:47.397679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] PATH_INFO: `/v3/users/55768aa930cf45a6a75939c56c12c3b6` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:47.398796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=55768aa930cf45a6a75939c56c12c3b6)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:47.400739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:47.464205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55768aa930cf45a6a75939c56c12c3b6'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.474148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55768aa930cf45a6a75939c56c12c3b6'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.474779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55768aa930cf45a6a75939c56c12c3b6'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.488315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55768aa930cf45a6a75939c56c12c3b6'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.495529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-64c83d1e-7dbe-4cb6-80bb-9b94eb968cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55768aa930cf45a6a75939c56c12c3b6'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.509196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:51:47.517302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1105/2228] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:51:47 2022] DELETE /identity/v3/users/55768aa930cf45a6a75939c56c12c3b6 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:51:47.714949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee31d-97cd-4b55-877b-76cd9518f2a6 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:47.730267 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee31d-97cd-4b55-877b-76cd9518f2a6 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:47.853842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:47.854754 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:47.855288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:47.855839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] PATH_INFO: `/v3/projects/4b1c07ecd24d4965a98f2996ece078d7` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:47.857305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1c07ecd24d4965a98f2996ece078d7)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:47.860245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:47.926096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1c07ecd24d4965a98f2996ece078d7', 'request_id': 'req-f88930b0-5944-47af-8b6e-50b2892eddce'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.938523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1c07ecd24d4965a98f2996ece078d7', 'request_id': 'req-f88930b0-5944-47af-8b6e-50b2892eddce'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.945883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1c07ecd24d4965a98f2996ece078d7', 'request_id': 'req-f88930b0-5944-47af-8b6e-50b2892eddce'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.957505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] The token cache is being invalidate because project 4b1c07ecd24d4965a98f2996ece078d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:51:47.957792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.958453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f88930b0-5944-47af-8b6e-50b2892eddce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:51:47.959934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1124/2229] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:51:47 2022] DELETE /identity/v3/projects/4b1c07ecd24d4965a98f2996ece078d7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:51:47.965913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a8fe-805c-4cce-8134-0e5b712fd3ee None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:47.966201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a8fe-805c-4cce-8134-0e5b712fd3ee None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:47.966485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff31a8fe-805c-4cce-8134-0e5b712fd3ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:47.986855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ff31a8fe-805c-4cce-8134-0e5b712fd3ee None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:47.988047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ff31a8fe-805c-4cce-8134-0e5b712fd3ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:48.056842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1106/2230] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:51:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:48.065076 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43a35-5bf2-435e-ab52-cbd0144d2879 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:48.065423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43a35-5bf2-435e-ab52-cbd0144d2879 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:48.065647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c43a35-5bf2-435e-ab52-cbd0144d2879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:48.085477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-31c43a35-5bf2-435e-ab52-cbd0144d2879 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:48.086959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-31c43a35-5bf2-435e-ab52-cbd0144d2879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:48.097482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1125/2231] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:51:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:48.100787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31a8fe-805c-4cce-8134-0e5b712fd3ee None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:48.113567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff31a8fe-805c-4cce-8134-0e5b712fd3ee None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:48.119384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f65732-5ea6-43e4-a907-c18ef237bc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:48.120416 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f65732-5ea6-43e4-a907-c18ef237bc97 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:48.120693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f65732-5ea6-43e4-a907-c18ef237bc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:48.121055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f65732-5ea6-43e4-a907-c18ef237bc97 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:48.121813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f65732-5ea6-43e4-a907-c18ef237bc97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:51:48.122122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f65732-5ea6-43e4-a907-c18ef237bc97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:48.124171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f65732-5ea6-43e4-a907-c18ef237bc97 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:48.140115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1107/2232] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:51:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:51:48.144476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43a35-5bf2-435e-ab52-cbd0144d2879 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:48.155867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c43a35-5bf2-435e-ab52-cbd0144d2879 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:48.160992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45bb77-cf22-4f63-bdf4-2062601c3eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:48.161721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45bb77-cf22-4f63-bdf4-2062601c3eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:48.162115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45bb77-cf22-4f63-bdf4-2062601c3eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:48.162458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45bb77-cf22-4f63-bdf4-2062601c3eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:48.163299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45bb77-cf22-4f63-bdf4-2062601c3eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:48.165302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45bb77-cf22-4f63-bdf4-2062601c3eb5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:48.181651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:51:48.195002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1126/2233] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:51:48 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:51:48.199503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f65732-5ea6-43e4-a907-c18ef237bc97 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:48.210841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f65732-5ea6-43e4-a907-c18ef237bc97 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:48.276072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffa017-93f2-4ea0-8073-b9531c030fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:48.276883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa017-93f2-4ea0-8073-b9531c030fb6 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:48.277311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa017-93f2-4ea0-8073-b9531c030fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:48.277833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ffa017-93f2-4ea0-8073-b9531c030fb6 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:48.278568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffa017-93f2-4ea0-8073-b9531c030fb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:48.293862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ffa017-93f2-4ea0-8073-b9531c030fb6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:48.329815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1108/2234] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:51:48 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:51:48.333656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45bb77-cf22-4f63-bdf4-2062601c3eb5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:48.350424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45bb77-cf22-4f63-bdf4-2062601c3eb5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:48.357126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5328f4-f10d-4003-80ff-0aa6522e486f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:48.357906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5328f4-f10d-4003-80ff-0aa6522e486f admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:48.358336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5328f4-f10d-4003-80ff-0aa6522e486f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:48.358699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5328f4-f10d-4003-80ff-0aa6522e486f admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:48.359541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5328f4-f10d-4003-80ff-0aa6522e486f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:48.366792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5328f4-f10d-4003-80ff-0aa6522e486f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:48.377984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1127/2235] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:51:48.381916 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffa017-93f2-4ea0-8073-b9531c030fb6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:48.413669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ffa017-93f2-4ea0-8073-b9531c030fb6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:48.429688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc8f65-57f5-474d-8460-d43a2097758e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:48.430470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc8f65-57f5-474d-8460-d43a2097758e admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:48.430914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc8f65-57f5-474d-8460-d43a2097758e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:48.431291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc8f65-57f5-474d-8460-d43a2097758e admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:48.432113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc8f65-57f5-474d-8460-d43a2097758e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:48.433829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc8f65-57f5-474d-8460-d43a2097758e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:48.471781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1109/2236] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:51:48.475967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5328f4-f10d-4003-80ff-0aa6522e486f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:48.488486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5328f4-f10d-4003-80ff-0aa6522e486f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:48.493718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e25a9b-277b-46c3-b805-4dc4b424d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:48.494637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e25a9b-277b-46c3-b805-4dc4b424d336 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:48.494917 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e25a9b-277b-46c3-b805-4dc4b424d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:48.495191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e25a9b-277b-46c3-b805-4dc4b424d336 admin admin] PATH_INFO: `/v3/projects/eb8f0fce5c424d3da7f20200f224c089/users/8b10a2edb590477aa000733e98195eec/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:48.513685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e25a9b-277b-46c3-b805-4dc4b424d336 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb8f0fce5c424d3da7f20200f224c089, user_id=8b10a2edb590477aa000733e98195eec, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:48.517041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e25a9b-277b-46c3-b805-4dc4b424d336 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:48.529950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1128/2237] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:51:48 2022] PUT /identity/v3/projects/eb8f0fce5c424d3da7f20200f224c089/users/8b10a2edb590477aa000733e98195eec/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:51:48.540778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c001a-2ce6-4031-a199-bc96e90451f2 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:48.541093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c001a-2ce6-4031-a199-bc96e90451f2 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:48.541368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c001a-2ce6-4031-a199-bc96e90451f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:48.575341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-324c001a-2ce6-4031-a199-bc96e90451f2 None None] MFA Rules not processed for user `8b10a2edb590477aa000733e98195eec`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:48.578050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-324c001a-2ce6-4031-a199-bc96e90451f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:48.636671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:51:48.647732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1110/2238] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:51:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:48.659868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e25a9b-277b-46c3-b805-4dc4b424d336 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:48.661932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-85e25a9b-277b-46c3-b805-4dc4b424d336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:48.725949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e25a9b-277b-46c3-b805-4dc4b424d336 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:48.730609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392d7978-0e9a-413b-bc7c-7b1e87e8d6d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babdd851ad7b4ba99b5746d8480bc082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:48.731226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7978-0e9a-413b-bc7c-7b1e87e8d6d7 service glance] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:48.731506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7978-0e9a-413b-bc7c-7b1e87e8d6d7 service glance] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:48.731779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392d7978-0e9a-413b-bc7c-7b1e87e8d6d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:48.741761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d7978-0e9a-413b-bc7c-7b1e87e8d6d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:48.743385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392d7978-0e9a-413b-bc7c-7b1e87e8d6d7 service glance] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:48.756822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1129/2239] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:51:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:51:57.119164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c001a-2ce6-4031-a199-bc96e90451f2 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:57.123940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-324c001a-2ce6-4031-a199-bc96e90451f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:57.189272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c001a-2ce6-4031-a199-bc96e90451f2 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:57.192765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:57.193369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:57.193679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:57.193950 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:57.195683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:57.260397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:57.262180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:57.274714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1111/2240] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:51:57 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:51:58.755279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:51:59.703266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135a33-03ae-4163-8d9c-5e2fbd533824 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:59.703622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135a33-03ae-4163-8d9c-5e2fbd533824 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:59.703989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e135a33-03ae-4163-8d9c-5e2fbd533824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:59.745340 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-9e135a33-03ae-4163-8d9c-5e2fbd533824 None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:51:59.746750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9e135a33-03ae-4163-8d9c-5e2fbd533824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:59.819175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1130/2241] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 17 00:51:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:51:59.833228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:51:59.835052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:51:59.942205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689d7f94-0d11-48ac-a738-315ce33b22bf service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:51:59.947876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b56e1b-4a72-45f1-8711-2f795197141a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:51:59.948507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b56e1b-4a72-45f1-8711-2f795197141a service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:51:59.948786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b56e1b-4a72-45f1-8711-2f795197141a service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:51:59.949059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b56e1b-4a72-45f1-8711-2f795197141a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:51:59.960013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b56e1b-4a72-45f1-8711-2f795197141a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:51:59.961938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b56e1b-4a72-45f1-8711-2f795197141a service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:51:59.974947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1112/2242] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:51:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:52:09.810389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=25 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:52:09.972242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=85 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:52:13.711615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a9c2-f9a4-4cbb-ad70-024c9dcee084 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:13.712545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a9c2-f9a4-4cbb-ad70-024c9dcee084 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:13.712826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb3a9c2-f9a4-4cbb-ad70-024c9dcee084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:13.733375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-deb3a9c2-f9a4-4cbb-ad70-024c9dcee084 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:13.734727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-deb3a9c2-f9a4-4cbb-ad70-024c9dcee084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:13.769348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b56e1b-4a72-45f1-8711-2f795197141a service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:13.829534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1131/2243] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:52:13.858380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a9c2-f9a4-4cbb-ad70-024c9dcee084 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:13.860118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-deb3a9c2-f9a4-4cbb-ad70-024c9dcee084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:13.940159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b56e1b-4a72-45f1-8711-2f795197141a service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:13.958445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:13.959624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:13.960109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:13.960974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] PATH_INFO: `/v3/users/8b10a2edb590477aa000733e98195eec` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:13.962660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b10a2edb590477aa000733e98195eec)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:13.965047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:13.980748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb3a9c2-f9a4-4cbb-ad70-024c9dcee084 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:13.987078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b9ad4-df4e-4412-b938-d0bdce459d28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:13.987699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b9ad4-df4e-4412-b938-d0bdce459d28 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:13.987978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b9ad4-df4e-4412-b938-d0bdce459d28 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:13.988303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b9ad4-df4e-4412-b938-d0bdce459d28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:13.997108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b9ad4-df4e-4412-b938-d0bdce459d28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:13.998777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b9ad4-df4e-4412-b938-d0bdce459d28 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:14.009066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1132/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:52:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:52:14.027102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b10a2edb590477aa000733e98195eec'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.037959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b10a2edb590477aa000733e98195eec'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.038724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b10a2edb590477aa000733e98195eec'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.053631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b10a2edb590477aa000733e98195eec'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.062727 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b10a2edb590477aa000733e98195eec'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.073030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1113/2245] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:52:13 2022] DELETE /identity/v3/users/8b10a2edb590477aa000733e98195eec => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:52:14.074804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0ed54-2344-427c-b2b8-a140d597d9ed None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:14.075081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0ed54-2344-427c-b2b8-a140d597d9ed None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:14.075355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0ed54-2344-427c-b2b8-a140d597d9ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:14.096177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-42d0ed54-2344-427c-b2b8-a140d597d9ed None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:14.097634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-42d0ed54-2344-427c-b2b8-a140d597d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:14.157732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1133/2246] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:52:14.167438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:14.168896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:14.228638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a1eb3-f6e7-45ef-a84a-ad9735f1c13b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:14.232288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f37b9c4-f0a5-4f17-ae72-b8120da8e8a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:14.232892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37b9c4-f0a5-4f17-ae72-b8120da8e8a3 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:14.233170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37b9c4-f0a5-4f17-ae72-b8120da8e8a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:14.233538 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f37b9c4-f0a5-4f17-ae72-b8120da8e8a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:14.242452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37b9c4-f0a5-4f17-ae72-b8120da8e8a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:14.243866 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f37b9c4-f0a5-4f17-ae72-b8120da8e8a3 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:14.253741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1114/2247] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:52:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:52:14.520558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0ed54-2344-427c-b2b8-a140d597d9ed None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:14.522179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-42d0ed54-2344-427c-b2b8-a140d597d9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:14.534029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0ed54-2344-427c-b2b8-a140d597d9ed None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:14.539056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:14.539697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:14.539978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:14.540252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] PATH_INFO: `/v3/projects/eb8f0fce5c424d3da7f20200f224c089` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:14.542092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb8f0fce5c424d3da7f20200f224c089)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:14.544062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:14.568423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:52:14.595842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb8f0fce5c424d3da7f20200f224c089', 'request_id': 'req-4a3deb70-f229-41bd-946e-fbca494fa48d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.607962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb8f0fce5c424d3da7f20200f224c089', 'request_id': 'req-4a3deb70-f229-41bd-946e-fbca494fa48d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.614212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb8f0fce5c424d3da7f20200f224c089', 'request_id': 'req-4a3deb70-f229-41bd-946e-fbca494fa48d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.626576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] The token cache is being invalidate because project eb8f0fce5c424d3da7f20200f224c089 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:52:14.626938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.627587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:14.629288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1134/2248] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:52:14 2022] DELETE /identity/v3/projects/eb8f0fce5c424d3da7f20200f224c089 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:52:16.944983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a91cf-f872-43ab-9625-964abb433883 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:16.945569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a91cf-f872-43ab-9625-964abb433883 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:16.945569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933a91cf-f872-43ab-9625-964abb433883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:16.966217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-933a91cf-f872-43ab-9625-964abb433883 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:16.968075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-933a91cf-f872-43ab-9625-964abb433883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:16.988211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:52:17.040185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1115/2249] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:52:17.059460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:17.061515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:17.138226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3deb70-f229-41bd-946e-fbca494fa48d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:17.144411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808d486-afab-4b04-88e0-a56143e23e8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:17.145024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808d486-afab-4b04-88e0-a56143e23e8b service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:17.145316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808d486-afab-4b04-88e0-a56143e23e8b service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:17.145624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1808d486-afab-4b04-88e0-a56143e23e8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:17.154855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808d486-afab-4b04-88e0-a56143e23e8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:17.156598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1808d486-afab-4b04-88e0-a56143e23e8b service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:17.167934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1135/2250] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:52:22.086581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481050b3-83de-4aa1-8a95-d1a4e708e52b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:22.087082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481050b3-83de-4aa1-8a95-d1a4e708e52b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:22.087174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481050b3-83de-4aa1-8a95-d1a4e708e52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:22.111525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-481050b3-83de-4aa1-8a95-d1a4e708e52b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:22.111525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-481050b3-83de-4aa1-8a95-d1a4e708e52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:22.118168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1116/2251] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:52:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:52:22.132779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808d486-afab-4b04-88e0-a56143e23e8b service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:22.134287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1808d486-afab-4b04-88e0-a56143e23e8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:22.149362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1808d486-afab-4b04-88e0-a56143e23e8b service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:22.155936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8c767-a762-4bd8-931d-1a22de3fbfe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:22.156532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8c767-a762-4bd8-931d-1a22de3fbfe3 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:22.156815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8c767-a762-4bd8-931d-1a22de3fbfe3 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:22.157091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a8c767-a762-4bd8-931d-1a22de3fbfe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:22.165351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8c767-a762-4bd8-931d-1a22de3fbfe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:22.167015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a8c767-a762-4bd8-931d-1a22de3fbfe3 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:22.179871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1136/2252] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:52:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:52:25.248314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c838049-1468-4fd6-9720-cee918b4d1b9 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:25.248759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c838049-1468-4fd6-9720-cee918b4d1b9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:25.248888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c838049-1468-4fd6-9720-cee918b4d1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:25.270190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3c838049-1468-4fd6-9720-cee918b4d1b9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:25.270190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3c838049-1468-4fd6-9720-cee918b4d1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:25.279311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1117/2253] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:52:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:52:25.301645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8c767-a762-4bd8-931d-1a22de3fbfe3 service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:25.312634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a8c767-a762-4bd8-931d-1a22de3fbfe3 service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:25.318296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfbd2c-5e42-444f-ad64-529e7a2a3cc8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:25.318893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbd2c-5e42-444f-ad64-529e7a2a3cc8 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:25.319172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbd2c-5e42-444f-ad64-529e7a2a3cc8 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:25.319445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfbd2c-5e42-444f-ad64-529e7a2a3cc8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:25.327809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfbd2c-5e42-444f-ad64-529e7a2a3cc8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:25.329393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfbd2c-5e42-444f-ad64-529e7a2a3cc8 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:25.339088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1137/2254] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:52:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:52:27.097596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196937a-b127-4ac0-be73-bae621ac0909 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:27.098432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196937a-b127-4ac0-be73-bae621ac0909 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:27.099064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196937a-b127-4ac0-be73-bae621ac0909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:27.118594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2196937a-b127-4ac0-be73-bae621ac0909 None None] MFA Rules not processed for user `e33cf9baa72248739f58cb3a3d7d078b`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:27.119774 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2196937a-b127-4ac0-be73-bae621ac0909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:27.174564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1118/2255] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:52:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:52:28.416732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6021662-dad2-4135-ba92-1c4ac36081fd None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:28.417196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6021662-dad2-4135-ba92-1c4ac36081fd None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:28.417306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6021662-dad2-4135-ba92-1c4ac36081fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:28.439387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a6021662-dad2-4135-ba92-1c4ac36081fd None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:28.440592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a6021662-dad2-4135-ba92-1c4ac36081fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:28.448480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1138/2256] 10.222.0.20 () {58 vars in 1016 bytes} [Sat Sep 17 00:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:52:28.473977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196937a-b127-4ac0-be73-bae621ac0909 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:28.487281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196937a-b127-4ac0-be73-bae621ac0909 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:28.492675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd97c3-4dc8-4843-9483-02f7a5cac856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:28.493288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd97c3-4dc8-4843-9483-02f7a5cac856 service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:28.493604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd97c3-4dc8-4843-9483-02f7a5cac856 service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:28.493881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd97c3-4dc8-4843-9483-02f7a5cac856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:28.502696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd97c3-4dc8-4843-9483-02f7a5cac856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:28.504271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd97c3-4dc8-4843-9483-02f7a5cac856 service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:28.513788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1119/2257] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:52:38.433970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=7,keystone:SELECT=64,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:52:38.509565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=54 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:52:56.090282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765149dd-effa-460d-b8e2-c3c80a582d8f None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:56.090844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765149dd-effa-460d-b8e2-c3c80a582d8f None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:56.090844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765149dd-effa-460d-b8e2-c3c80a582d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:56.110166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-765149dd-effa-460d-b8e2-c3c80a582d8f None None] MFA Rules not processed for user `aac4f2beca334a7f8c62924b5d7e4fe5`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:56.111389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-765149dd-effa-460d-b8e2-c3c80a582d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:56.169605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1139/2258] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:52:56 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:52:59.332529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd97c3-4dc8-4843-9483-02f7a5cac856 service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:59.334723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a1dd97c3-4dc8-4843-9483-02f7a5cac856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:59.349386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd97c3-4dc8-4843-9483-02f7a5cac856 service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:59.354440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:59.355131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:59.355414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:59.355888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] PATH_INFO: `/v3/users/93ec2dfa15cf4e5792b4c88a953c3a1c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:59.357562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] RBAC: Authorizing `identity:delete_user(user_id=93ec2dfa15cf4e5792b4c88a953c3a1c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:59.360091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:59.409831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93ec2dfa15cf4e5792b4c88a953c3a1c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.423578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93ec2dfa15cf4e5792b4c88a953c3a1c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.424226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93ec2dfa15cf4e5792b4c88a953c3a1c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.438681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93ec2dfa15cf4e5792b4c88a953c3a1c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.446081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-66bc303f-95a5-4640-894a-f2de5898835e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93ec2dfa15cf4e5792b4c88a953c3a1c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.452274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1120/2259] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:52:59 2022] DELETE /identity/v3/users/93ec2dfa15cf4e5792b4c88a953c3a1c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:52:59.620867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765149dd-effa-460d-b8e2-c3c80a582d8f None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:59.634221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765149dd-effa-460d-b8e2-c3c80a582d8f None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:59.699035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:59.699750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:59.700194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:59.700893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] PATH_INFO: `/v3/projects/b20252dee2ca48bdbb7a9e8b470ad5c8` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:59.702094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b20252dee2ca48bdbb7a9e8b470ad5c8)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:59.704002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:59.756279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b20252dee2ca48bdbb7a9e8b470ad5c8', 'request_id': 'req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.765137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b20252dee2ca48bdbb7a9e8b470ad5c8', 'request_id': 'req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.772584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b20252dee2ca48bdbb7a9e8b470ad5c8', 'request_id': 'req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.784324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] The token cache is being invalidate because project b20252dee2ca48bdbb7a9e8b470ad5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:52:59.784612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.785275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f1398bf6-1fbb-487b-afe7-21eb24f2ab97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:52:59.786983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1140/2260] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:52:59 2022] DELETE /identity/v3/projects/b20252dee2ca48bdbb7a9e8b470ad5c8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:52:59.791702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bcaf8-9139-4da8-8b85-b33ae238fbde None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:59.791984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bcaf8-9139-4da8-8b85-b33ae238fbde None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:59.792257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bcaf8-9139-4da8-8b85-b33ae238fbde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:59.812459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8f8bcaf8-9139-4da8-8b85-b33ae238fbde None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:59.813709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8f8bcaf8-9139-4da8-8b85-b33ae238fbde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:59.874267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1121/2261] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:52:59.881645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4290-a939-4e2e-8972-d9ad93b920ea None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:59.881935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4290-a939-4e2e-8972-d9ad93b920ea None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:59.882211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4290-a939-4e2e-8972-d9ad93b920ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:59.901927 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-781f4290-a939-4e2e-8972-d9ad93b920ea None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:52:59.903248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-781f4290-a939-4e2e-8972-d9ad93b920ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:52:59.912413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1141/2262] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:52:59.917248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bcaf8-9139-4da8-8b85-b33ae238fbde None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:59.935579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bcaf8-9139-4da8-8b85-b33ae238fbde None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:59.943245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69045f6e-7a3d-4945-951c-91aced7da0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:59.943864 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69045f6e-7a3d-4945-951c-91aced7da0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:59.944141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69045f6e-7a3d-4945-951c-91aced7da0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:59.944409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69045f6e-7a3d-4945-951c-91aced7da0f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:59.945084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69045f6e-7a3d-4945-951c-91aced7da0f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:52:59.945359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69045f6e-7a3d-4945-951c-91aced7da0f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:59.947028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69045f6e-7a3d-4945-951c-91aced7da0f2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:52:59.959302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1122/2263] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:52:59.963781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f4290-a939-4e2e-8972-d9ad93b920ea None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:52:59.973698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781f4290-a939-4e2e-8972-d9ad93b920ea None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:52:59.978513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a620364-b612-42b0-b953-c9e375017d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:52:59.979256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a620364-b612-42b0-b953-c9e375017d50 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:52:59.979542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a620364-b612-42b0-b953-c9e375017d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:52:59.979839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a620364-b612-42b0-b953-c9e375017d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:52:59.980475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a620364-b612-42b0-b953-c9e375017d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:52:59.983090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a620364-b612-42b0-b953-c9e375017d50 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:00.014090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1142/2264] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:52:59 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:53:00.015308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69045f6e-7a3d-4945-951c-91aced7da0f2 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:00.027593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69045f6e-7a3d-4945-951c-91aced7da0f2 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:00.041153 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba87140-a39b-429f-8bd6-b074cdef0277 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:00.041532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba87140-a39b-429f-8bd6-b074cdef0277 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:00.041813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba87140-a39b-429f-8bd6-b074cdef0277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:00.057560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:53:00.064158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-cba87140-a39b-429f-8bd6-b074cdef0277 None None] MFA Rules not processed for user `fc89c54d75e14107b79c30cabdb91ae1`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:53:00.065965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-cba87140-a39b-429f-8bd6-b074cdef0277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:00.088820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684a962-1c4a-4a57-a940-6041222c3ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:00.089836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684a962-1c4a-4a57-a940-6041222c3ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:00.089836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684a962-1c4a-4a57-a940-6041222c3ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:00.090061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684a962-1c4a-4a57-a940-6041222c3ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:00.090609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684a962-1c4a-4a57-a940-6041222c3ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:00.093082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684a962-1c4a-4a57-a940-6041222c3ed5 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:00.101906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:53:00.119037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1123/2265] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:53:00 2022] POST /identity/v3/users => generated 295 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:53:00.123092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684a962-1c4a-4a57-a940-6041222c3ed5 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:00.124227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1143/2266] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:53:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:53:00.134503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684a962-1c4a-4a57-a940-6041222c3ed5 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:00.139626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77191c24-f6d7-46b2-9477-7d2d4c13be7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:00.140228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77191c24-f6d7-46b2-9477-7d2d4c13be7f admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:00.140510 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77191c24-f6d7-46b2-9477-7d2d4c13be7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:00.140787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77191c24-f6d7-46b2-9477-7d2d4c13be7f admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:00.141455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77191c24-f6d7-46b2-9477-7d2d4c13be7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:00.143054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77191c24-f6d7-46b2-9477-7d2d4c13be7f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:00.154634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1124/2267] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:53:00.158429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba87140-a39b-429f-8bd6-b074cdef0277 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:00.169356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba87140-a39b-429f-8bd6-b074cdef0277 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:00.174228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ef7c7-2cf8-41fe-b764-ef546deff66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:00.174996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef7c7-2cf8-41fe-b764-ef546deff66f admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:00.175121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef7c7-2cf8-41fe-b764-ef546deff66f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:00.175362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ef7c7-2cf8-41fe-b764-ef546deff66f admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:00.176009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ef7c7-2cf8-41fe-b764-ef546deff66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:00.177842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ef7c7-2cf8-41fe-b764-ef546deff66f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:00.191763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1144/2268] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:53:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:53:00.192861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77191c24-f6d7-46b2-9477-7d2d4c13be7f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:00.203581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77191c24-f6d7-46b2-9477-7d2d4c13be7f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:00.208234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afbdf-80b8-4cea-a185-86e564e6bce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:00.208895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afbdf-80b8-4cea-a185-86e564e6bce7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:00.209176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afbdf-80b8-4cea-a185-86e564e6bce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:00.209504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902afbdf-80b8-4cea-a185-86e564e6bce7 admin admin] PATH_INFO: `/v3/projects/f2ca5bd09a434d6f8d8f4b096fe98e8d/users/1bd4c79e136d4109a402559b20a10c2e/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:00.225180 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902afbdf-80b8-4cea-a185-86e564e6bce7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ca5bd09a434d6f8d8f4b096fe98e8d, user_id=1bd4c79e136d4109a402559b20a10c2e, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:00.227921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902afbdf-80b8-4cea-a185-86e564e6bce7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:00.241893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1125/2269] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:53:00 2022] PUT /identity/v3/projects/f2ca5bd09a434d6f8d8f4b096fe98e8d/users/1bd4c79e136d4109a402559b20a10c2e/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:53:00.252082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38f49-2e03-4c11-b809-2ffa1ea3ee51 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:00.252354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38f49-2e03-4c11-b809-2ffa1ea3ee51 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:00.252632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a38f49-2e03-4c11-b809-2ffa1ea3ee51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:00.283391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-48a38f49-2e03-4c11-b809-2ffa1ea3ee51 None None] MFA Rules not processed for user `1bd4c79e136d4109a402559b20a10c2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:53:00.284660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-48a38f49-2e03-4c11-b809-2ffa1ea3ee51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:00.353656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1145/2270] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:53:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:53:00.364516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afbdf-80b8-4cea-a185-86e564e6bce7 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:00.366302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-902afbdf-80b8-4cea-a185-86e564e6bce7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:00.427933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902afbdf-80b8-4cea-a185-86e564e6bce7 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:00.435132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd8c97-a9be-4316-a36c-c5d08bcb811f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:00.435758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd8c97-a9be-4316-a36c-c5d08bcb811f service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:00.436164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd8c97-a9be-4316-a36c-c5d08bcb811f service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:00.436437 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd8c97-a9be-4316-a36c-c5d08bcb811f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:00.445431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd8c97-a9be-4316-a36c-c5d08bcb811f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:00.446863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdd8c97-a9be-4316-a36c-c5d08bcb811f service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:00.457063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1126/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:53:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:53:10.350784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=59 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:53:10.452222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:INSERT=4,keystone:SELECT=43 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:53:10.765213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38f49-2e03-4c11-b809-2ffa1ea3ee51 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:10.847142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a38f49-2e03-4c11-b809-2ffa1ea3ee51 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:10.852659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:10.853375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:10.853756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:10.854107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] PATH_INFO: `/v3/users/1bd4c79e136d4109a402559b20a10c2e` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:10.855342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd4c79e136d4109a402559b20a10c2e)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:10.857429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:10.913642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd4c79e136d4109a402559b20a10c2e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:10.922435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd4c79e136d4109a402559b20a10c2e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:10.923224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd4c79e136d4109a402559b20a10c2e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:10.931184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd4c79e136d4109a402559b20a10c2e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:10.945257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd4c79e136d4109a402559b20a10c2e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:10.952106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1146/2272] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:53:10 2022] DELETE /identity/v3/users/1bd4c79e136d4109a402559b20a10c2e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:53:10.956322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c2825-9c65-4be6-b2b7-1ea152d46fea None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:10.956641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c2825-9c65-4be6-b2b7-1ea152d46fea None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:10.956920 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c2825-9c65-4be6-b2b7-1ea152d46fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:10.977526 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-bd3c2825-9c65-4be6-b2b7-1ea152d46fea None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:53:10.978821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bd3c2825-9c65-4be6-b2b7-1ea152d46fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:11.047276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1127/2273] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:53:11.057589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:11.059004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:11.120988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c2fc95-b9a0-443a-bbfb-8ca6658d03ee admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:11.125311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2a30ed-cb72-492a-bfef-fc957b61749e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:11.126111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a30ed-cb72-492a-bfef-fc957b61749e service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:11.126398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a30ed-cb72-492a-bfef-fc957b61749e service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:11.126674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2a30ed-cb72-492a-bfef-fc957b61749e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:11.137042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a30ed-cb72-492a-bfef-fc957b61749e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:11.139081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2a30ed-cb72-492a-bfef-fc957b61749e service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:11.149571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1147/2274] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:53:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:53:11.561112 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c2825-9c65-4be6-b2b7-1ea152d46fea None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:11.562630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bd3c2825-9c65-4be6-b2b7-1ea152d46fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:11.574742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c2825-9c65-4be6-b2b7-1ea152d46fea None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:11.580021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:11.580803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:11.581138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:11.581491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] PATH_INFO: `/v3/projects/f2ca5bd09a434d6f8d8f4b096fe98e8d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:11.582790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ca5bd09a434d6f8d8f4b096fe98e8d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:11.584746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:11.650722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ca5bd09a434d6f8d8f4b096fe98e8d', 'request_id': 'req-afb005bf-f83d-4287-8e21-d9b7ac7967a8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:11.660164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ca5bd09a434d6f8d8f4b096fe98e8d', 'request_id': 'req-afb005bf-f83d-4287-8e21-d9b7ac7967a8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:11.666254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ca5bd09a434d6f8d8f4b096fe98e8d', 'request_id': 'req-afb005bf-f83d-4287-8e21-d9b7ac7967a8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:11.679684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] The token cache is being invalidate because project f2ca5bd09a434d6f8d8f4b096fe98e8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:53:11.679892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:11.680635 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:53:11.682753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1128/2275] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:53:11 2022] DELETE /identity/v3/projects/f2ca5bd09a434d6f8d8f4b096fe98e8d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:53:12.259195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c108-f79a-4b85-ae39-c0c3c6a012b7 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:12.259682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c108-f79a-4b85-ae39-c0c3c6a012b7 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:12.259801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8528c108-f79a-4b85-ae39-c0c3c6a012b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:12.279806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8528c108-f79a-4b85-ae39-c0c3c6a012b7 None None] MFA Rules not processed for user `9adb6ad92cbf40db90405f8f45a9ae3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:53:12.280991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8528c108-f79a-4b85-ae39-c0c3c6a012b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:12.296941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:53:12.335099 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1148/2276] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:53:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:53:21.675791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:53:22.328548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=15 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:53:34.743453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:34.744910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:34.803124 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb005bf-f83d-4287-8e21-d9b7ac7967a8 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:34.806735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50625418-a9f9-4859-bb3c-a0bea683a08c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:34.807335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625418-a9f9-4859-bb3c-a0bea683a08c service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:34.807609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625418-a9f9-4859-bb3c-a0bea683a08c service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:34.807878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50625418-a9f9-4859-bb3c-a0bea683a08c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:34.809600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-50625418-a9f9-4859-bb3c-a0bea683a08c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:34.877021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50625418-a9f9-4859-bb3c-a0bea683a08c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:34.878444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50625418-a9f9-4859-bb3c-a0bea683a08c service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:34.889641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1129/2277] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:53:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:53:35.055880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c108-f79a-4b85-ae39-c0c3c6a012b7 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:35.066266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8528c108-f79a-4b85-ae39-c0c3c6a012b7 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:35.069809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:35.070403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:35.070683 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:35.070971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:35.072648 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:35.086553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:35.087960 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:35.098593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1149/2278] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:53:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:53:43.837931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c26b-8147-4b95-b179-cfc9255cb66c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:43.838396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c26b-8147-4b95-b179-cfc9255cb66c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:43.838603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33c26b-8147-4b95-b179-cfc9255cb66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:43.859890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ca33c26b-8147-4b95-b179-cfc9255cb66c None None] MFA Rules not processed for user `e33cf9baa72248739f58cb3a3d7d078b`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:53:43.861109 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ca33c26b-8147-4b95-b179-cfc9255cb66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:43.926473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1130/2279] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:53:43 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:53:45.093871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=6 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:53:50.827272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:50.828819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:50.842900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2f494-72a5-4a70-bb9c-2b860a3d62b2 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:50.848533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:50.849171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:50.849486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:50.849766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:50.851475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:50.913223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:50.914836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:50.924225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1150/2280] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:53:50 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:53:53.920402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=79 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:53:57.376889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd68a4-41fe-4475-9971-0b1c539b71c4 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:57.377636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd68a4-41fe-4475-9971-0b1c539b71c4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:57.377636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd68a4-41fe-4475-9971-0b1c539b71c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:57.399284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b1dd68a4-41fe-4475-9971-0b1c539b71c4 None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:53:57.400471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b1dd68a4-41fe-4475-9971-0b1c539b71c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:57.468437 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1131/2281] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 17 00:53:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:53:57.518385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:57.519802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:57.614419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cd105-6aae-4686-8286-86110f79f6a5 service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:57.621397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d81a2-a8f7-455d-b4a4-0e84b0984742 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:57.622357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d81a2-a8f7-455d-b4a4-0e84b0984742 service swift] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:57.622778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d81a2-a8f7-455d-b4a4-0e84b0984742 service swift] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:57.623090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d81a2-a8f7-455d-b4a4-0e84b0984742 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:57.641257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d81a2-a8f7-455d-b4a4-0e84b0984742 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:57.643135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0d81a2-a8f7-455d-b4a4-0e84b0984742 service swift] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:57.653010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1151/2282] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:53:59.122425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd68a4-41fe-4475-9971-0b1c539b71c4 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:53:59.135664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd68a4-41fe-4475-9971-0b1c539b71c4 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:53:59.142580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:53:59.143206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:53:59.143483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:53:59.143753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:53:59.146292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:53:59.158477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:53:59.160100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:53:59.181832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1132/2283] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:53:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:00.373323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d81a2-a8f7-455d-b4a4-0e84b0984742 service swift] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:00.376436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3d0d81a2-a8f7-455d-b4a4-0e84b0984742 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:00.392110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0d81a2-a8f7-455d-b4a4-0e84b0984742 service swift] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:00.398938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:00.400621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:00.400621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:00.400621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:00.404338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:00.495184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:00.496708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:00.507906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1152/2284] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:04.765612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:04.767162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:04.845364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b17673-c820-48fe-a11c-f0d57645afaa service nova] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:04.849953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:04.850777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:04.851213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:04.851668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:04.853677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:04.867329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:04.869944 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:04.882148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1133/2285] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:05.363110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:05.365141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:05.379315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea55bcd-ab9b-41fb-9658-f437de85a91c service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:05.382979 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73cc4b-649a-4b1d-b133-9bcb08aaba94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:05.383602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73cc4b-649a-4b1d-b133-9bcb08aaba94 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:05.383952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73cc4b-649a-4b1d-b133-9bcb08aaba94 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:05.384313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73cc4b-649a-4b1d-b133-9bcb08aaba94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:05.386108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-da73cc4b-649a-4b1d-b133-9bcb08aaba94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:05.423150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:05.478823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73cc4b-649a-4b1d-b133-9bcb08aaba94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:05.480152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73cc4b-649a-4b1d-b133-9bcb08aaba94 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:05.493168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1153/2286] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:06.459204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:06.461558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:06.479537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf3ec8b-8c4a-4cc3-9517-1739db34c68b service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:06.484778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:06.485453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:06.485718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:06.485989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] PATH_INFO: `/v3/users/c00ec99ee3fb48b485e5bac4a31b2841` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:06.487272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c00ec99ee3fb48b485e5bac4a31b2841)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:06.489190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:06.551531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c00ec99ee3fb48b485e5bac4a31b2841'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.562077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c00ec99ee3fb48b485e5bac4a31b2841'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.562951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c00ec99ee3fb48b485e5bac4a31b2841'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.579418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c00ec99ee3fb48b485e5bac4a31b2841'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.587456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c00ec99ee3fb48b485e5bac4a31b2841'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.597193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1134/2287] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:06 2022] DELETE /identity/v3/users/c00ec99ee3fb48b485e5bac4a31b2841 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:06.784757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73cc4b-649a-4b1d-b133-9bcb08aaba94 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:06.802145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73cc4b-649a-4b1d-b133-9bcb08aaba94 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:06.866068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:06.866737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:06.867004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:06.867278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] PATH_INFO: `/v3/projects/a55bacccc6064fd4bc3e8cb76fe1b502` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:06.868455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55bacccc6064fd4bc3e8cb76fe1b502)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:06.870477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:06.925348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55bacccc6064fd4bc3e8cb76fe1b502', 'request_id': 'req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.935724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55bacccc6064fd4bc3e8cb76fe1b502', 'request_id': 'req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.942243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55bacccc6064fd4bc3e8cb76fe1b502', 'request_id': 'req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.954183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] The token cache is being invalidate because project a55bacccc6064fd4bc3e8cb76fe1b502 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:06.954617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.955282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:06.956795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1154/2288] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:06 2022] DELETE /identity/v3/projects/a55bacccc6064fd4bc3e8cb76fe1b502 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:06.960928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:06.962726 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:06.976548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b3bb5-2a7c-46ae-82f4-afa5e9912282 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:06.980665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:07.036614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:07.037258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:07.037571 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:07.037848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] PATH_INFO: `/v3/users/d470e88ab32c404abab5217b34828d47` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:07.039067 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d470e88ab32c404abab5217b34828d47)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:07.040943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:07.095106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd470e88ab32c404abab5217b34828d47'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.109938 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd470e88ab32c404abab5217b34828d47'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.110896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd470e88ab32c404abab5217b34828d47'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.125605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd470e88ab32c404abab5217b34828d47'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.136458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd470e88ab32c404abab5217b34828d47'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.143302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1135/2289] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:06 2022] DELETE /identity/v3/users/d470e88ab32c404abab5217b34828d47 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:07.396883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:07.399013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:07.436666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5909e7db-6ba8-4f46-9c84-53bd3c4c24a8 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:07.498164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:07.510330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:07.510553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:07.510823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:07.511093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] PATH_INFO: `/v3/projects/b88b1d2bfa6e43f2b2a775c33519f417` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:07.513421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b88b1d2bfa6e43f2b2a775c33519f417)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:07.515705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:07.575669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b88b1d2bfa6e43f2b2a775c33519f417', 'request_id': 'req-cc62eb30-742d-475e-9357-8b83abb65f5b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.584744 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b88b1d2bfa6e43f2b2a775c33519f417', 'request_id': 'req-cc62eb30-742d-475e-9357-8b83abb65f5b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.591995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b88b1d2bfa6e43f2b2a775c33519f417', 'request_id': 'req-cc62eb30-742d-475e-9357-8b83abb65f5b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.605826 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] The token cache is being invalidate because project b88b1d2bfa6e43f2b2a775c33519f417 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:07.606388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.607331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:07.609628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1155/2290] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:07 2022] DELETE /identity/v3/projects/b88b1d2bfa6e43f2b2a775c33519f417 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:09.239684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:09.241288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:09.256998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800447cd-8ced-40d9-a99c-9a91b9ebe293 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:09.321479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:09.322163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:09.322413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:09.322693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] PATH_INFO: `/v3/users/aac4f2beca334a7f8c62924b5d7e4fe5` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:09.324193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aac4f2beca334a7f8c62924b5d7e4fe5)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:09.327412 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:09.330982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:09.333160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:09.361595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:09.383182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aac4f2beca334a7f8c62924b5d7e4fe5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.391693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aac4f2beca334a7f8c62924b5d7e4fe5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.392645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aac4f2beca334a7f8c62924b5d7e4fe5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.405870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aac4f2beca334a7f8c62924b5d7e4fe5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.417699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aac4f2beca334a7f8c62924b5d7e4fe5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.418320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62eb30-742d-475e-9357-8b83abb65f5b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:09.423971 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1136/2291] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:09 2022] DELETE /identity/v3/users/aac4f2beca334a7f8c62924b5d7e4fe5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:09.426776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ef8954-7a42-43f3-8713-a0c0d5dfcb53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:09.427685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8954-7a42-43f3-8713-a0c0d5dfcb53 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:09.427887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8954-7a42-43f3-8713-a0c0d5dfcb53 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:09.428179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ef8954-7a42-43f3-8713-a0c0d5dfcb53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:09.430056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-84ef8954-7a42-43f3-8713-a0c0d5dfcb53 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:09.492020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef8954-7a42-43f3-8713-a0c0d5dfcb53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:09.493683 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ef8954-7a42-43f3-8713-a0c0d5dfcb53 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:09.511430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1156/2292] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:09.616662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:09.618661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:09.705146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16764175-613c-40bd-8aff-fae67ad9c2f4 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:09.709876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:09.710511 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:09.710792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:09.711327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] PATH_INFO: `/v3/projects/3ba7e7c6841c492581d7d22fb8905dfb` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:09.712621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ba7e7c6841c492581d7d22fb8905dfb)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:09.715556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:09.766013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ba7e7c6841c492581d7d22fb8905dfb', 'request_id': 'req-9c226443-4e30-4f81-bb9d-e76d51465a0b'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.774294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ba7e7c6841c492581d7d22fb8905dfb', 'request_id': 'req-9c226443-4e30-4f81-bb9d-e76d51465a0b'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.783344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ba7e7c6841c492581d7d22fb8905dfb', 'request_id': 'req-9c226443-4e30-4f81-bb9d-e76d51465a0b'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.802560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] The token cache is being invalidate because project 3ba7e7c6841c492581d7d22fb8905dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:09.803095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.803854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9c226443-4e30-4f81-bb9d-e76d51465a0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:09.806098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1137/2293] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:09 2022] DELETE /identity/v3/projects/3ba7e7c6841c492581d7d22fb8905dfb => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:09.812557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169154-f7ab-460c-aa76-2a0b1f88fa63 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:09.813068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169154-f7ab-460c-aa76-2a0b1f88fa63 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:09.813468 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c169154-f7ab-460c-aa76-2a0b1f88fa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:09.836255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-5c169154-f7ab-460c-aa76-2a0b1f88fa63 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:09.837509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5c169154-f7ab-460c-aa76-2a0b1f88fa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:09.851957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:09.929511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1157/2294] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:09.932256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605882a-e25c-4a84-b3aa-6a559b096b9c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:09.932543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605882a-e25c-4a84-b3aa-6a559b096b9c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:09.932817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605882a-e25c-4a84-b3aa-6a559b096b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:09.954282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-4605882a-e25c-4a84-b3aa-6a559b096b9c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:09.955693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4605882a-e25c-4a84-b3aa-6a559b096b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:09.964310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1138/2295] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:09.968534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c169154-f7ab-460c-aa76-2a0b1f88fa63 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:09.978529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c169154-f7ab-460c-aa76-2a0b1f88fa63 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:09.983772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8cc8-63d0-4588-8fb7-67d9250cd63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:09.984320 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8cc8-63d0-4588-8fb7-67d9250cd63f admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:09.984598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8cc8-63d0-4588-8fb7-67d9250cd63f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:09.984872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02b8cc8-63d0-4588-8fb7-67d9250cd63f admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:09.985567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8cc8-63d0-4588-8fb7-67d9250cd63f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:54:09.985872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8cc8-63d0-4588-8fb7-67d9250cd63f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:09.987456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02b8cc8-63d0-4588-8fb7-67d9250cd63f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:09.999590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1158/2296] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:54:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:54:10.003778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605882a-e25c-4a84-b3aa-6a559b096b9c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.012882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605882a-e25c-4a84-b3aa-6a559b096b9c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.017612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857d79-6515-4440-8a37-1c6ba7be6471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.018213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857d79-6515-4440-8a37-1c6ba7be6471 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.018494 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857d79-6515-4440-8a37-1c6ba7be6471 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.018772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00857d79-6515-4440-8a37-1c6ba7be6471 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.019430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00857d79-6515-4440-8a37-1c6ba7be6471 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.021338 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00857d79-6515-4440-8a37-1c6ba7be6471 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.048084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1139/2297] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:10 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:10.052202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8cc8-63d0-4588-8fb7-67d9250cd63f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.062980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02b8cc8-63d0-4588-8fb7-67d9250cd63f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.123528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e30fd-9b4b-4af0-8a6d-e99964ec41b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.124138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e30fd-9b4b-4af0-8a6d-e99964ec41b9 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.124534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e30fd-9b4b-4af0-8a6d-e99964ec41b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.124814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e30fd-9b4b-4af0-8a6d-e99964ec41b9 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.125476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e30fd-9b4b-4af0-8a6d-e99964ec41b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.127398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54e30fd-9b4b-4af0-8a6d-e99964ec41b9 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.148396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1159/2298] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:10 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:10.152600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857d79-6515-4440-8a37-1c6ba7be6471 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.162818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00857d79-6515-4440-8a37-1c6ba7be6471 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.167462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15a473-9c7d-4509-bd2f-04766726d352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.168061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15a473-9c7d-4509-bd2f-04766726d352 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.168342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15a473-9c7d-4509-bd2f-04766726d352 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.169178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e15a473-9c7d-4509-bd2f-04766726d352 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.169906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15a473-9c7d-4509-bd2f-04766726d352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.171503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e15a473-9c7d-4509-bd2f-04766726d352 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.172763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:10.183838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1140/2299] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:10.188179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e30fd-9b4b-4af0-8a6d-e99964ec41b9 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.198073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54e30fd-9b4b-4af0-8a6d-e99964ec41b9 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.202724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be79a11-cf89-4474-b74c-283b23be5575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.203313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be79a11-cf89-4474-b74c-283b23be5575 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.203596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be79a11-cf89-4474-b74c-283b23be5575 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.203870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be79a11-cf89-4474-b74c-283b23be5575 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.204511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be79a11-cf89-4474-b74c-283b23be5575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.206144 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be79a11-cf89-4474-b74c-283b23be5575 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.217328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1160/2300] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:10.221277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15a473-9c7d-4509-bd2f-04766726d352 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.231114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e15a473-9c7d-4509-bd2f-04766726d352 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.236265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401509b9-45ff-40ed-83e0-75eb61a3330d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.236848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401509b9-45ff-40ed-83e0-75eb61a3330d admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.237127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401509b9-45ff-40ed-83e0-75eb61a3330d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.237417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401509b9-45ff-40ed-83e0-75eb61a3330d admin admin] PATH_INFO: `/v3/projects/2749fb2f41724755b352da8db3a22643/users/b953d66d4962493b98e2a334b9c40649/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.252887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401509b9-45ff-40ed-83e0-75eb61a3330d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2749fb2f41724755b352da8db3a22643, user_id=b953d66d4962493b98e2a334b9c40649, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.255602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401509b9-45ff-40ed-83e0-75eb61a3330d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.268369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1141/2301] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:10 2022] PUT /identity/v3/projects/2749fb2f41724755b352da8db3a22643/users/b953d66d4962493b98e2a334b9c40649/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:10.280350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810220ad-9e9d-4756-9b6c-ed70dfa16fe5 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.280643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810220ad-9e9d-4756-9b6c-ed70dfa16fe5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.280918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810220ad-9e9d-4756-9b6c-ed70dfa16fe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.308852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-810220ad-9e9d-4756-9b6c-ed70dfa16fe5 None None] MFA Rules not processed for user `b953d66d4962493b98e2a334b9c40649`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:10.310132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-810220ad-9e9d-4756-9b6c-ed70dfa16fe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:10.374125 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1161/2302] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:10.378808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401509b9-45ff-40ed-83e0-75eb61a3330d admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.439470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401509b9-45ff-40ed-83e0-75eb61a3330d admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.444200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e58710-f263-4528-a393-423966bd4500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.444805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e58710-f263-4528-a393-423966bd4500 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.445086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e58710-f263-4528-a393-423966bd4500 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.445361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e58710-f263-4528-a393-423966bd4500 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.446021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e58710-f263-4528-a393-423966bd4500 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.447927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e58710-f263-4528-a393-423966bd4500 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.474368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1142/2303] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:10 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:10.478456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810220ad-9e9d-4756-9b6c-ed70dfa16fe5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.489684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810220ad-9e9d-4756-9b6c-ed70dfa16fe5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.498328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:10.546246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbed437-4983-4760-9171-5d6de5d2066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.546866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbed437-4983-4760-9171-5d6de5d2066f admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.547150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbed437-4983-4760-9171-5d6de5d2066f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.547426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbed437-4983-4760-9171-5d6de5d2066f admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.548059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbed437-4983-4760-9171-5d6de5d2066f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.550014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbed437-4983-4760-9171-5d6de5d2066f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.570655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1162/2304] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:10 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:10.574580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e58710-f263-4528-a393-423966bd4500 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.585427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e58710-f263-4528-a393-423966bd4500 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.590418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6a53-fc6c-4695-a046-d8422f7163d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.591638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6a53-fc6c-4695-a046-d8422f7163d8 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.591919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6a53-fc6c-4695-a046-d8422f7163d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.592197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf6a53-fc6c-4695-a046-d8422f7163d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.592858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6a53-fc6c-4695-a046-d8422f7163d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.594473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bf6a53-fc6c-4695-a046-d8422f7163d8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.604761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1143/2305] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:10.609200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbed437-4983-4760-9171-5d6de5d2066f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.619393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbed437-4983-4760-9171-5d6de5d2066f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.624840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc7ccf-11f2-43e6-ad7c-ee86d375667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.625520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc7ccf-11f2-43e6-ad7c-ee86d375667e admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.625806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc7ccf-11f2-43e6-ad7c-ee86d375667e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.626086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acc7ccf-11f2-43e6-ad7c-ee86d375667e admin admin] PATH_INFO: `/v3/projects/c5c6314a5c6645ed98a3cfc88becc6ef/users/ce81753f4e6d43ee874649eb87342af7/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.640567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc7ccf-11f2-43e6-ad7c-ee86d375667e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c6314a5c6645ed98a3cfc88becc6ef, user_id=ce81753f4e6d43ee874649eb87342af7, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.643245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acc7ccf-11f2-43e6-ad7c-ee86d375667e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.656321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1163/2306] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:10 2022] PUT /identity/v3/projects/c5c6314a5c6645ed98a3cfc88becc6ef/users/ce81753f4e6d43ee874649eb87342af7/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:10.660286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6a53-fc6c-4695-a046-d8422f7163d8 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.670882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf6a53-fc6c-4695-a046-d8422f7163d8 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.725819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9821fb-a7c9-4be5-a5ae-87d435e0d4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.726594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9821fb-a7c9-4be5-a5ae-87d435e0d4e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.726764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9821fb-a7c9-4be5-a5ae-87d435e0d4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.727056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9821fb-a7c9-4be5-a5ae-87d435e0d4e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.727624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9821fb-a7c9-4be5-a5ae-87d435e0d4e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.729210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9821fb-a7c9-4be5-a5ae-87d435e0d4e2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.739242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1144/2307] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:10.743499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc7ccf-11f2-43e6-ad7c-ee86d375667e admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.754462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acc7ccf-11f2-43e6-ad7c-ee86d375667e admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.758964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd227a9b-22e5-4f04-af1f-67658c2fe7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.759600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd227a9b-22e5-4f04-af1f-67658c2fe7e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.759877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd227a9b-22e5-4f04-af1f-67658c2fe7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.760149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd227a9b-22e5-4f04-af1f-67658c2fe7e5 admin admin] PATH_INFO: `/v3/projects/c5c6314a5c6645ed98a3cfc88becc6ef/users/ce81753f4e6d43ee874649eb87342af7/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.762035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd227a9b-22e5-4f04-af1f-67658c2fe7e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5c6314a5c6645ed98a3cfc88becc6ef, user_id=ce81753f4e6d43ee874649eb87342af7, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.764669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd227a9b-22e5-4f04-af1f-67658c2fe7e5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.774616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1164/2308] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:10 2022] PUT /identity/v3/projects/c5c6314a5c6645ed98a3cfc88becc6ef/users/ce81753f4e6d43ee874649eb87342af7/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:10.784505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae4336-67d2-46a0-bb45-86a021dbc2c9 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.784792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae4336-67d2-46a0-bb45-86a021dbc2c9 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.785066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfae4336-67d2-46a0-bb45-86a021dbc2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.812966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-dfae4336-67d2-46a0-bb45-86a021dbc2c9 None None] MFA Rules not processed for user `ce81753f4e6d43ee874649eb87342af7`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:10.814207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-dfae4336-67d2-46a0-bb45-86a021dbc2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:10.855417 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:10.888129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1145/2309] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:10 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:10.899677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd227a9b-22e5-4f04-af1f-67658c2fe7e5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:10.901592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-bd227a9b-22e5-4f04-af1f-67658c2fe7e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:10.963583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd227a9b-22e5-4f04-af1f-67658c2fe7e5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:10.967778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895b15e-2a4c-4df8-bafc-17c685c2327d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:10.968363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895b15e-2a4c-4df8-bafc-17c685c2327d service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:10.968639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895b15e-2a4c-4df8-bafc-17c685c2327d service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:10.968908 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e895b15e-2a4c-4df8-bafc-17c685c2327d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:10.978353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895b15e-2a4c-4df8-bafc-17c685c2327d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:10.979816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e895b15e-2a4c-4df8-bafc-17c685c2327d service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:10.990996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1165/2310] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:10 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:11.070743 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae4336-67d2-46a0-bb45-86a021dbc2c9 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:11.081308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfae4336-67d2-46a0-bb45-86a021dbc2c9 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:11.085057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cf2ed2-f574-4e80-bf90-839850a06fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:11.085766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2ed2-f574-4e80-bf90-839850a06fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:11.086360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2ed2-f574-4e80-bf90-839850a06fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:11.086732 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cf2ed2-f574-4e80-bf90-839850a06fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:11.155871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2ed2-f574-4e80-bf90-839850a06fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:11.157614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cf2ed2-f574-4e80-bf90-839850a06fc4 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:11.172536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1146/2311] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:11 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:13.938966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895b15e-2a4c-4df8-bafc-17c685c2327d service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:14.003811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e895b15e-2a4c-4df8-bafc-17c685c2327d service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:14.009523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:14.010162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:14.010467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:14.010740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] PATH_INFO: `/v3/users/b953d66d4962493b98e2a334b9c40649` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:14.011866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b953d66d4962493b98e2a334b9c40649)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:14.013898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:14.024957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:14.063399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b953d66d4962493b98e2a334b9c40649'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.071304 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b953d66d4962493b98e2a334b9c40649'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.071923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b953d66d4962493b98e2a334b9c40649'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.079503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b953d66d4962493b98e2a334b9c40649'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.093240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b953d66d4962493b98e2a334b9c40649'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.099491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1166/2312] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:13 2022] DELETE /identity/v3/users/b953d66d4962493b98e2a334b9c40649 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:14.104373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e3b07-502c-486f-acab-8d5f7c3bcce8 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:14.104886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e3b07-502c-486f-acab-8d5f7c3bcce8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:14.104886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e3b07-502c-486f-acab-8d5f7c3bcce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:14.130915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-114e3b07-502c-486f-acab-8d5f7c3bcce8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:14.132268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-114e3b07-502c-486f-acab-8d5f7c3bcce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:14.201615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1147/2313] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:14.211728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:14.213141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:14.271919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353bad0-082d-4571-9667-c08bee5b28df admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:14.275594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48751f-1a10-4d74-afbf-da5b7dfd2d5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:14.276197 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48751f-1a10-4d74-afbf-da5b7dfd2d5e service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:14.276473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48751f-1a10-4d74-afbf-da5b7dfd2d5e service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:14.276742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d48751f-1a10-4d74-afbf-da5b7dfd2d5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:14.285710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48751f-1a10-4d74-afbf-da5b7dfd2d5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:14.287140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d48751f-1a10-4d74-afbf-da5b7dfd2d5e service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:14.296635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1167/2314] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:14.560965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e3b07-502c-486f-acab-8d5f7c3bcce8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:14.562644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-114e3b07-502c-486f-acab-8d5f7c3bcce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:14.576086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e3b07-502c-486f-acab-8d5f7c3bcce8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:14.588083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:14.588083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:14.588349 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:14.588526 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] PATH_INFO: `/v3/projects/2749fb2f41724755b352da8db3a22643` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:14.589780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2749fb2f41724755b352da8db3a22643)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:14.591830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:14.642392 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2749fb2f41724755b352da8db3a22643', 'request_id': 'req-7d54e25b-c67c-41d6-b01b-f30069449a5c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.650513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2749fb2f41724755b352da8db3a22643', 'request_id': 'req-7d54e25b-c67c-41d6-b01b-f30069449a5c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.654626 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:14.658827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2749fb2f41724755b352da8db3a22643', 'request_id': 'req-7d54e25b-c67c-41d6-b01b-f30069449a5c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.672362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] The token cache is being invalidate because project 2749fb2f41724755b352da8db3a22643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:14.672652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.673301 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.674817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1148/2315] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:14 2022] DELETE /identity/v3/projects/2749fb2f41724755b352da8db3a22643 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:14.678971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48751f-1a10-4d74-afbf-da5b7dfd2d5e service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:14.689366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d48751f-1a10-4d74-afbf-da5b7dfd2d5e service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:14.750138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:14.750786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:14.751066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:14.751344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] PATH_INFO: `/v3/users/ce81753f4e6d43ee874649eb87342af7` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:14.752521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce81753f4e6d43ee874649eb87342af7)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:14.754560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:14.789044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:14.802806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce81753f4e6d43ee874649eb87342af7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.810098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce81753f4e6d43ee874649eb87342af7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.810720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce81753f4e6d43ee874649eb87342af7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.817690 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce81753f4e6d43ee874649eb87342af7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.829714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-b16d8f53-46e8-4a28-b265-a738af1146af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce81753f4e6d43ee874649eb87342af7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:14.835538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1168/2316] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:14 2022] DELETE /identity/v3/users/ce81753f4e6d43ee874649eb87342af7 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:15.098955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:15.100398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:15.113533 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d54e25b-c67c-41d6-b01b-f30069449a5c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:15.169202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:15.169877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.170159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.170435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] PATH_INFO: `/v3/projects/c5c6314a5c6645ed98a3cfc88becc6ef` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.171574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5c6314a5c6645ed98a3cfc88becc6ef)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:15.173530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:15.222413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5c6314a5c6645ed98a3cfc88becc6ef', 'request_id': 'req-7f8aaac0-c517-4177-894b-07789d2f3c78'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:15.230268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5c6314a5c6645ed98a3cfc88becc6ef', 'request_id': 'req-7f8aaac0-c517-4177-894b-07789d2f3c78'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:15.235873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5c6314a5c6645ed98a3cfc88becc6ef', 'request_id': 'req-7f8aaac0-c517-4177-894b-07789d2f3c78'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:15.246733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] The token cache is being invalidate because project c5c6314a5c6645ed98a3cfc88becc6ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:15.247023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:15.247649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-7f8aaac0-c517-4177-894b-07789d2f3c78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:15.249159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1149/2317] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:15 2022] DELETE /identity/v3/projects/c5c6314a5c6645ed98a3cfc88becc6ef => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:15.254842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee53f-e798-4b3c-b2c4-747912545a06 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.255303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee53f-e798-4b3c-b2c4-747912545a06 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.255426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee53f-e798-4b3c-b2c4-747912545a06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.275204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-547ee53f-e798-4b3c-b2c4-747912545a06 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:15.276460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-547ee53f-e798-4b3c-b2c4-747912545a06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:15.334009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1169/2318] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:15.342515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f01cc-cc08-41d1-b08b-2088118bdf7f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.342745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f01cc-cc08-41d1-b08b-2088118bdf7f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.343023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83f01cc-cc08-41d1-b08b-2088118bdf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.363289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-c83f01cc-cc08-41d1-b08b-2088118bdf7f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:15.364471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c83f01cc-cc08-41d1-b08b-2088118bdf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:15.372254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1150/2319] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:15.376316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee53f-e798-4b3c-b2c4-747912545a06 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:15.385872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee53f-e798-4b3c-b2c4-747912545a06 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:15.391009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa58516-87fc-41d0-80a5-48c1016e1034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:15.391624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa58516-87fc-41d0-80a5-48c1016e1034 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.391905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa58516-87fc-41d0-80a5-48c1016e1034 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.392181 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa58516-87fc-41d0-80a5-48c1016e1034 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.392840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa58516-87fc-41d0-80a5-48c1016e1034 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:54:15.393148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa58516-87fc-41d0-80a5-48c1016e1034 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:15.394877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa58516-87fc-41d0-80a5-48c1016e1034 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:15.408303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1170/2320] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:54:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:54:15.412608 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f01cc-cc08-41d1-b08b-2088118bdf7f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:15.423466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83f01cc-cc08-41d1-b08b-2088118bdf7f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:15.428985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f4338-9846-4e9b-a7b2-dbaa1532cc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:15.429719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f4338-9846-4e9b-a7b2-dbaa1532cc4a admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.430319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f4338-9846-4e9b-a7b2-dbaa1532cc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.430596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f4338-9846-4e9b-a7b2-dbaa1532cc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.431229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f4338-9846-4e9b-a7b2-dbaa1532cc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:15.433138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f4338-9846-4e9b-a7b2-dbaa1532cc4a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:15.466122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1151/2321] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:15 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:15.467586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa58516-87fc-41d0-80a5-48c1016e1034 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:15.477565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa58516-87fc-41d0-80a5-48c1016e1034 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:15.541912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8705a-cdbb-4d36-a748-ca927bbfca85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:15.542698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8705a-cdbb-4d36-a748-ca927bbfca85 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.543004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8705a-cdbb-4d36-a748-ca927bbfca85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.543882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8705a-cdbb-4d36-a748-ca927bbfca85 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.544537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8705a-cdbb-4d36-a748-ca927bbfca85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:15.546586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8705a-cdbb-4d36-a748-ca927bbfca85 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:15.568852 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1171/2322] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:15 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:15.572970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f4338-9846-4e9b-a7b2-dbaa1532cc4a admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:15.583261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f4338-9846-4e9b-a7b2-dbaa1532cc4a admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:15.588415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794ca92-e275-462b-8138-729d0a5ab719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:15.589264 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794ca92-e275-462b-8138-729d0a5ab719 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.589599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794ca92-e275-462b-8138-729d0a5ab719 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.589909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e794ca92-e275-462b-8138-729d0a5ab719 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.591147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794ca92-e275-462b-8138-729d0a5ab719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:15.593665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e794ca92-e275-462b-8138-729d0a5ab719 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:15.603586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1152/2323] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:15.608108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8705a-cdbb-4d36-a748-ca927bbfca85 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:15.618203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8705a-cdbb-4d36-a748-ca927bbfca85 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:15.623158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9d55d-6075-4770-a7b6-e00174da7027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:15.623755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9d55d-6075-4770-a7b6-e00174da7027 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.624037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9d55d-6075-4770-a7b6-e00174da7027 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.624313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9d55d-6075-4770-a7b6-e00174da7027 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.625018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9d55d-6075-4770-a7b6-e00174da7027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:15.626649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9d55d-6075-4770-a7b6-e00174da7027 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:15.637391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1172/2324] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:15.641424 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794ca92-e275-462b-8138-729d0a5ab719 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:15.651300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e794ca92-e275-462b-8138-729d0a5ab719 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:15.656410 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a371ac-b33e-4197-b21b-29af5e98367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:15.657052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a371ac-b33e-4197-b21b-29af5e98367e admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.657331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a371ac-b33e-4197-b21b-29af5e98367e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.657632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a371ac-b33e-4197-b21b-29af5e98367e admin admin] PATH_INFO: `/v3/projects/00f4f7564cd64e1ba72580f563807f2c/users/1362772928504c1692f588123fe7e889/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.672148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a371ac-b33e-4197-b21b-29af5e98367e admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f4f7564cd64e1ba72580f563807f2c, user_id=1362772928504c1692f588123fe7e889, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:15.674824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a371ac-b33e-4197-b21b-29af5e98367e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:15.687708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1153/2325] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:15 2022] PUT /identity/v3/projects/00f4f7564cd64e1ba72580f563807f2c/users/1362772928504c1692f588123fe7e889/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:15.698808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177df1e-92d4-4a84-93ce-f93dfc0150a5 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.699090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177df1e-92d4-4a84-93ce-f93dfc0150a5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.699363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c177df1e-92d4-4a84-93ce-f93dfc0150a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.727988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c177df1e-92d4-4a84-93ce-f93dfc0150a5 None None] MFA Rules not processed for user `1362772928504c1692f588123fe7e889`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:15.729194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c177df1e-92d4-4a84-93ce-f93dfc0150a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:15.733868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:15.796550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1173/2326] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:15.801178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a371ac-b33e-4197-b21b-29af5e98367e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:15.818772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:15.868158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a371ac-b33e-4197-b21b-29af5e98367e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:15.873118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5077a2-6215-413e-bf1e-81fcaa35ae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:15.873863 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5077a2-6215-413e-bf1e-81fcaa35ae75 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.874141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5077a2-6215-413e-bf1e-81fcaa35ae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.874414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5077a2-6215-413e-bf1e-81fcaa35ae75 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.875086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5077a2-6215-413e-bf1e-81fcaa35ae75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:15.877032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5077a2-6215-413e-bf1e-81fcaa35ae75 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:15.909219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1154/2327] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:15 2022] POST /identity/v3/projects => generated 377 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:15.910565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177df1e-92d4-4a84-93ce-f93dfc0150a5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:15.921206 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c177df1e-92d4-4a84-93ce-f93dfc0150a5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:15.976347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57bb4-1db2-4635-ac20-36299b6c9d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:15.976954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57bb4-1db2-4635-ac20-36299b6c9d25 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:15.977234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57bb4-1db2-4635-ac20-36299b6c9d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:15.977540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b57bb4-1db2-4635-ac20-36299b6c9d25 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:15.978177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b57bb4-1db2-4635-ac20-36299b6c9d25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:15.980096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b57bb4-1db2-4635-ac20-36299b6c9d25 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:16.002436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1174/2328] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:15 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:16.006429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5077a2-6215-413e-bf1e-81fcaa35ae75 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:16.016701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5077a2-6215-413e-bf1e-81fcaa35ae75 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:16.021773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8ad60-30d7-4478-aafe-fcfb7b64b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:16.022577 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ad60-30d7-4478-aafe-fcfb7b64b19a admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:16.022859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ad60-30d7-4478-aafe-fcfb7b64b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:16.023131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c8ad60-30d7-4478-aafe-fcfb7b64b19a admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:16.023772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8ad60-30d7-4478-aafe-fcfb7b64b19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:16.025364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c8ad60-30d7-4478-aafe-fcfb7b64b19a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:16.035926 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1155/2329] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:16.039907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57bb4-1db2-4635-ac20-36299b6c9d25 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:16.050244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b57bb4-1db2-4635-ac20-36299b6c9d25 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:16.054823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02a49-74a9-40e6-838e-7b3c9311569c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:16.055464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02a49-74a9-40e6-838e-7b3c9311569c admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:16.055743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02a49-74a9-40e6-838e-7b3c9311569c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:16.056018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f02a49-74a9-40e6-838e-7b3c9311569c admin admin] PATH_INFO: `/v3/projects/4a4a056f9f304172afb41dd2b01acf5c/users/61e8f49baf354f6da65cd8ddf6f1fa59/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:16.073292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f02a49-74a9-40e6-838e-7b3c9311569c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4a056f9f304172afb41dd2b01acf5c, user_id=61e8f49baf354f6da65cd8ddf6f1fa59, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:16.076052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f02a49-74a9-40e6-838e-7b3c9311569c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:16.088421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1175/2330] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:16 2022] PUT /identity/v3/projects/4a4a056f9f304172afb41dd2b01acf5c/users/61e8f49baf354f6da65cd8ddf6f1fa59/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:16.092327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8ad60-30d7-4478-aafe-fcfb7b64b19a admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:16.102184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c8ad60-30d7-4478-aafe-fcfb7b64b19a admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:16.158123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a49a0-5196-4c86-8570-f46904535894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:16.158781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a49a0-5196-4c86-8570-f46904535894 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:16.158984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a49a0-5196-4c86-8570-f46904535894 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:16.159254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a49a0-5196-4c86-8570-f46904535894 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:16.159882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a49a0-5196-4c86-8570-f46904535894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:16.161502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a49a0-5196-4c86-8570-f46904535894 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:16.171427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1156/2331] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:16.175682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02a49-74a9-40e6-838e-7b3c9311569c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:16.186403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f02a49-74a9-40e6-838e-7b3c9311569c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:16.191016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b390c-d518-47ec-8224-683cff222e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:16.191657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b390c-d518-47ec-8224-683cff222e0a admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:16.191936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b390c-d518-47ec-8224-683cff222e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:16.192209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b390c-d518-47ec-8224-683cff222e0a admin admin] PATH_INFO: `/v3/projects/4a4a056f9f304172afb41dd2b01acf5c/users/61e8f49baf354f6da65cd8ddf6f1fa59/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:16.194104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b390c-d518-47ec-8224-683cff222e0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a4a056f9f304172afb41dd2b01acf5c, user_id=61e8f49baf354f6da65cd8ddf6f1fa59, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:16.196724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b390c-d518-47ec-8224-683cff222e0a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:16.206814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1176/2332] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:16 2022] PUT /identity/v3/projects/4a4a056f9f304172afb41dd2b01acf5c/users/61e8f49baf354f6da65cd8ddf6f1fa59/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:16.217352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714b44-c261-4fc4-9321-444593984327 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:16.217686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714b44-c261-4fc4-9321-444593984327 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:16.217962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2714b44-c261-4fc4-9321-444593984327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:16.245993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e2714b44-c261-4fc4-9321-444593984327 None None] MFA Rules not processed for user `61e8f49baf354f6da65cd8ddf6f1fa59`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:16.247194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e2714b44-c261-4fc4-9321-444593984327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:16.319534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1157/2333] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:16.329921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b390c-d518-47ec-8224-683cff222e0a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:16.331717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2a0b390c-d518-47ec-8224-683cff222e0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:16.390680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b390c-d518-47ec-8224-683cff222e0a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:16.394338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f77b4cb-4c4a-41d2-bbc0-d3596513d7f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:16.394939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77b4cb-4c4a-41d2-bbc0-d3596513d7f7 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:16.395213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77b4cb-4c4a-41d2-bbc0-d3596513d7f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:16.395480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f77b4cb-4c4a-41d2-bbc0-d3596513d7f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:16.407915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:16.457141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77b4cb-4c4a-41d2-bbc0-d3596513d7f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:16.458623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f77b4cb-4c4a-41d2-bbc0-d3596513d7f7 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:16.467956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1177/2334] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:19.047027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2714b44-c261-4fc4-9321-444593984327 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:19.048475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e2714b44-c261-4fc4-9321-444593984327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:19.060563 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2714b44-c261-4fc4-9321-444593984327 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:19.064078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b01f2f-eddf-4945-8937-6b02751e9d36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:19.064668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01f2f-eddf-4945-8937-6b02751e9d36 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:19.064941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01f2f-eddf-4945-8937-6b02751e9d36 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:19.065212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b01f2f-eddf-4945-8937-6b02751e9d36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:19.073910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b01f2f-eddf-4945-8937-6b02751e9d36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:19.075809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b01f2f-eddf-4945-8937-6b02751e9d36 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:19.079584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:19.087121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1158/2335] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:22.417318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66be3d-4a16-4692-924a-70f7104e95a6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:22.417822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66be3d-4a16-4692-924a-70f7104e95a6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:22.417916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b66be3d-4a16-4692-924a-70f7104e95a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:22.439487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-4b66be3d-4a16-4692-924a-70f7104e95a6 None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:22.440794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4b66be3d-4a16-4692-924a-70f7104e95a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:22.496965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1178/2336] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:54:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:22.509512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b01f2f-eddf-4945-8937-6b02751e9d36 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:22.511255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-21b01f2f-eddf-4945-8937-6b02751e9d36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:22.593289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b01f2f-eddf-4945-8937-6b02751e9d36 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:22.598269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee46db1-e45d-4c3f-83cb-39a9968eb08b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:22.598889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee46db1-e45d-4c3f-83cb-39a9968eb08b service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:22.599167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee46db1-e45d-4c3f-83cb-39a9968eb08b service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:22.599442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee46db1-e45d-4c3f-83cb-39a9968eb08b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:22.608114 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee46db1-e45d-4c3f-83cb-39a9968eb08b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:22.609862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee46db1-e45d-4c3f-83cb-39a9968eb08b service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:22.618401 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1159/2337] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:54:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 00:54:22.896965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66be3d-4a16-4692-924a-70f7104e95a6 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:22.898515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4b66be3d-4a16-4692-924a-70f7104e95a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:23.146585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b66be3d-4a16-4692-924a-70f7104e95a6 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:23.180775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d123b58-7b97-4e99-ba5b-7bb2d0ba43ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:23.181493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d123b58-7b97-4e99-ba5b-7bb2d0ba43ca service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:23.181756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d123b58-7b97-4e99-ba5b-7bb2d0ba43ca service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:23.182219 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d123b58-7b97-4e99-ba5b-7bb2d0ba43ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:23.186674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6d123b58-7b97-4e99-ba5b-7bb2d0ba43ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:23.214019 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d123b58-7b97-4e99-ba5b-7bb2d0ba43ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:23.215720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d123b58-7b97-4e99-ba5b-7bb2d0ba43ca service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:23.237073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1179/2338] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:29.168480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee46db1-e45d-4c3f-83cb-39a9968eb08b service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:29.170032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bee46db1-e45d-4c3f-83cb-39a9968eb08b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:29.240333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee46db1-e45d-4c3f-83cb-39a9968eb08b service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:29.244143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99b6c12-6437-419d-9857-bec88c0c29eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:29.245030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b6c12-6437-419d-9857-bec88c0c29eb service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:29.245555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b6c12-6437-419d-9857-bec88c0c29eb service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:29.246670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99b6c12-6437-419d-9857-bec88c0c29eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:29.248682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d99b6c12-6437-419d-9857-bec88c0c29eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:29.322192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b6c12-6437-419d-9857-bec88c0c29eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:29.323896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99b6c12-6437-419d-9857-bec88c0c29eb service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:29.335322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1160/2339] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:32.422325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d123b58-7b97-4e99-ba5b-7bb2d0ba43ca service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:32.446118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d123b58-7b97-4e99-ba5b-7bb2d0ba43ca service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:32.456227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:32.457149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:32.457639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:32.458020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] PATH_INFO: `/v3/users/1362772928504c1692f588123fe7e889` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:32.459482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=1362772928504c1692f588123fe7e889)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:32.462609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:32.550672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:32.563216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1362772928504c1692f588123fe7e889'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:32.598621 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1362772928504c1692f588123fe7e889'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:32.604057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1362772928504c1692f588123fe7e889'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:32.632436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1362772928504c1692f588123fe7e889'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:32.672680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1362772928504c1692f588123fe7e889'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:32.682533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1180/2340] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:32 2022] DELETE /identity/v3/users/1362772928504c1692f588123fe7e889 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:32.687496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7339c4-45c5-4683-a7ff-8c3a2f1c6dd1 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:32.688358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7339c4-45c5-4683-a7ff-8c3a2f1c6dd1 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:32.688816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7339c4-45c5-4683-a7ff-8c3a2f1c6dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:32.713502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-bf7339c4-45c5-4683-a7ff-8c3a2f1c6dd1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:32.715657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bf7339c4-45c5-4683-a7ff-8c3a2f1c6dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:32.766556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:32.808517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1161/2341] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:32.818583 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:32.829821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:32.947553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497f56b2-2b99-46b9-ad00-f8554db36cfa admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:32.984524 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a555f-3116-4b62-b66a-ad88764eb096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:32.985168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a555f-3116-4b62-b66a-ad88764eb096 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:32.985559 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a555f-3116-4b62-b66a-ad88764eb096 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:32.985833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a555f-3116-4b62-b66a-ad88764eb096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:33.007035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a555f-3116-4b62-b66a-ad88764eb096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:33.009427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a555f-3116-4b62-b66a-ad88764eb096 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:33.032653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1181/2342] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:33.139385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7339c4-45c5-4683-a7ff-8c3a2f1c6dd1 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:33.141324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bf7339c4-45c5-4683-a7ff-8c3a2f1c6dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:33.171418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7339c4-45c5-4683-a7ff-8c3a2f1c6dd1 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:33.176343 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:33.177257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:33.177832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:33.178306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] PATH_INFO: `/v3/users/9adb6ad92cbf40db90405f8f45a9ae3a` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:33.179576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9adb6ad92cbf40db90405f8f45a9ae3a)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:33.182027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:33.276639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9adb6ad92cbf40db90405f8f45a9ae3a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.289315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9adb6ad92cbf40db90405f8f45a9ae3a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.290670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9adb6ad92cbf40db90405f8f45a9ae3a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.306115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9adb6ad92cbf40db90405f8f45a9ae3a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.318575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9adb6ad92cbf40db90405f8f45a9ae3a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.327720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1162/2343] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:33 2022] DELETE /identity/v3/users/9adb6ad92cbf40db90405f8f45a9ae3a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:33.597281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a555f-3116-4b62-b66a-ad88764eb096 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:33.599088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d57a555f-3116-4b62-b66a-ad88764eb096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:33.620002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a555f-3116-4b62-b66a-ad88764eb096 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:33.641214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:33.642914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:33.692892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:33.693663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:33.694130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:33.694500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] PATH_INFO: `/v3/projects/00f4f7564cd64e1ba72580f563807f2c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:33.695716 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f4f7564cd64e1ba72580f563807f2c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:33.697727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:33.718704 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e24ce7-62bd-4f0f-bea3-57868ef337b3 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:33.723848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:33.724496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:33.724764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:33.725092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] PATH_INFO: `/v3/projects/729a9ec9d2af438094ed4e7000d3d201` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:33.726204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=729a9ec9d2af438094ed4e7000d3d201)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:33.728152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:33.747733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f4f7564cd64e1ba72580f563807f2c', 'request_id': 'req-263ee53a-e616-4b7b-8a51-d87fcd65bc09'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.755458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f4f7564cd64e1ba72580f563807f2c', 'request_id': 'req-263ee53a-e616-4b7b-8a51-d87fcd65bc09'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.758519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:33.764128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f4f7564cd64e1ba72580f563807f2c', 'request_id': 'req-263ee53a-e616-4b7b-8a51-d87fcd65bc09'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.776585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] The token cache is being invalidate because project 00f4f7564cd64e1ba72580f563807f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:33.776902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.777698 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.778369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '729a9ec9d2af438094ed4e7000d3d201', 'request_id': 'req-0950153b-09f6-4f3f-b62b-6f9d11364855'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.779334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1182/2344] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:33 2022] DELETE /identity/v3/projects/00f4f7564cd64e1ba72580f563807f2c => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:33.782176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:33.783208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:33.784622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:33.787405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '729a9ec9d2af438094ed4e7000d3d201', 'request_id': 'req-0950153b-09f6-4f3f-b62b-6f9d11364855'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.795084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '729a9ec9d2af438094ed4e7000d3d201', 'request_id': 'req-0950153b-09f6-4f3f-b62b-6f9d11364855'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.807132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] The token cache is being invalidate because project 729a9ec9d2af438094ed4e7000d3d201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:33.807428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.808101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0950153b-09f6-4f3f-b62b-6f9d11364855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.810144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1163/2345] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:33 2022] DELETE /identity/v3/projects/729a9ec9d2af438094ed4e7000d3d201 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:33.814746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238be99a-a3ee-4dd3-a794-6140e7cf4252 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:33.815034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238be99a-a3ee-4dd3-a794-6140e7cf4252 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:33.815317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238be99a-a3ee-4dd3-a794-6140e7cf4252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:33.835784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-238be99a-a3ee-4dd3-a794-6140e7cf4252 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:33.837256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-238be99a-a3ee-4dd3-a794-6140e7cf4252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:33.852530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ee53a-e616-4b7b-8a51-d87fcd65bc09 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:33.918409 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1164/2346] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:33.921774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:33.922411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:33.922687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:33.922962 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] PATH_INFO: `/v3/users/61e8f49baf354f6da65cd8ddf6f1fa59` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:33.924095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=61e8f49baf354f6da65cd8ddf6f1fa59)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:33.925952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d1784-4037-4226-9fdb-f24433a0a4e1 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:33.926100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:33.926241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d1784-4037-4226-9fdb-f24433a0a4e1 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:33.926572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7d1784-4037-4226-9fdb-f24433a0a4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:33.946667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8e7d1784-4037-4226-9fdb-f24433a0a4e1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:33.947940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8e7d1784-4037-4226-9fdb-f24433a0a4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:33.958189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1165/2347] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:33.962740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d1784-4037-4226-9fdb-f24433a0a4e1 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:33.971897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7d1784-4037-4226-9fdb-f24433a0a4e1 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:33.976030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61e8f49baf354f6da65cd8ddf6f1fa59'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.976767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:33.977369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:33.977685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:33.977955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:33.978594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:54:33.978897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:33.981028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:33.985349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61e8f49baf354f6da65cd8ddf6f1fa59'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.986060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61e8f49baf354f6da65cd8ddf6f1fa59'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.993701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1166/2348] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:54:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:54:33.997624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61e8f49baf354f6da65cd8ddf6f1fa59'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:33.998366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.000773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:34.011378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61e8f49baf354f6da65cd8ddf6f1fa59'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:34.015104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231a0a1-c6c9-40d6-8eff-1ec43b39be07 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.018991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1183/2349] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:33 2022] DELETE /identity/v3/users/61e8f49baf354f6da65cd8ddf6f1fa59 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:34.022730 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daad3f-92cb-4115-a642-c0a9fb11b528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.023277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daad3f-92cb-4115-a642-c0a9fb11b528 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.023557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daad3f-92cb-4115-a642-c0a9fb11b528 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.023884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12daad3f-92cb-4115-a642-c0a9fb11b528 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.024615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12daad3f-92cb-4115-a642-c0a9fb11b528 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.026591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12daad3f-92cb-4115-a642-c0a9fb11b528 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.057078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1167/2350] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:33 2022] POST /identity/v3/projects => generated 371 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:34.062127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.077661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:34.146983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e43878-c490-4772-8d79-923e4b70ec7f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.216485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d8bb5-262c-45f1-83a7-b571a75ce67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.217079 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d8bb5-262c-45f1-83a7-b571a75ce67d admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.217356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d8bb5-262c-45f1-83a7-b571a75ce67d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.217659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d8bb5-262c-45f1-83a7-b571a75ce67d admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.218291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d8bb5-262c-45f1-83a7-b571a75ce67d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.220208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3d8bb5-262c-45f1-83a7-b571a75ce67d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.246308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1184/2351] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:34 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:34.247416 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daad3f-92cb-4115-a642-c0a9fb11b528 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.258106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12daad3f-92cb-4115-a642-c0a9fb11b528 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.262919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230a356-41af-4b2e-85c8-46661da40151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.263523 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230a356-41af-4b2e-85c8-46661da40151 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.263854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230a356-41af-4b2e-85c8-46661da40151 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.264126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5230a356-41af-4b2e-85c8-46661da40151 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.264778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230a356-41af-4b2e-85c8-46661da40151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.266415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5230a356-41af-4b2e-85c8-46661da40151 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.276308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1168/2352] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:34.280890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d8bb5-262c-45f1-83a7-b571a75ce67d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.290763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3d8bb5-262c-45f1-83a7-b571a75ce67d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.295964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a025b5-fc89-45c7-8671-9ff4f53b05a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.296563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a025b5-fc89-45c7-8671-9ff4f53b05a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.296837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a025b5-fc89-45c7-8671-9ff4f53b05a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.297106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a025b5-fc89-45c7-8671-9ff4f53b05a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.297786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a025b5-fc89-45c7-8671-9ff4f53b05a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.299375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a025b5-fc89-45c7-8671-9ff4f53b05a6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.312229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1185/2353] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:34.313377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230a356-41af-4b2e-85c8-46661da40151 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.324757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5230a356-41af-4b2e-85c8-46661da40151 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.329321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de8759-f57c-450e-bd47-83d11bb00923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.330009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8759-f57c-450e-bd47-83d11bb00923 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.330285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8759-f57c-450e-bd47-83d11bb00923 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.330565 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de8759-f57c-450e-bd47-83d11bb00923 admin admin] PATH_INFO: `/v3/projects/0a6c602ddf9e49a299b8ec65ef61aee1/users/855a1018d9794be99c51fbed6e4f482a/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.347023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de8759-f57c-450e-bd47-83d11bb00923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a6c602ddf9e49a299b8ec65ef61aee1, user_id=855a1018d9794be99c51fbed6e4f482a, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.349749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de8759-f57c-450e-bd47-83d11bb00923 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.364881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1169/2354] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:34 2022] PUT /identity/v3/projects/0a6c602ddf9e49a299b8ec65ef61aee1/users/855a1018d9794be99c51fbed6e4f482a/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:34.376351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcdc06-1545-4f4a-87b9-442d78c08626 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.376723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcdc06-1545-4f4a-87b9-442d78c08626 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.377066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcdc06-1545-4f4a-87b9-442d78c08626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.405812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c4bcdc06-1545-4f4a-87b9-442d78c08626 None None] MFA Rules not processed for user `855a1018d9794be99c51fbed6e4f482a`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:34.407119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c4bcdc06-1545-4f4a-87b9-442d78c08626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:34.481396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1186/2355] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:34.481684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de8759-f57c-450e-bd47-83d11bb00923 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.483641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-99de8759-f57c-450e-bd47-83d11bb00923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:34.485695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcdc06-1545-4f4a-87b9-442d78c08626 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.521077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:34.565243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcdc06-1545-4f4a-87b9-442d78c08626 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.570870 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b01f-f795-4ed4-a2a7-aa50fca6c3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.571493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b01f-f795-4ed4-a2a7-aa50fca6c3db admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.571778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b01f-f795-4ed4-a2a7-aa50fca6c3db admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.572062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b01f-f795-4ed4-a2a7-aa50fca6c3db admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.572724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5b01f-f795-4ed4-a2a7-aa50fca6c3db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.575366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5b01f-f795-4ed4-a2a7-aa50fca6c3db admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.587850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de8759-f57c-450e-bd47-83d11bb00923 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.593595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.594445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.594828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.595556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] PATH_INFO: `/v3/projects/4a4a056f9f304172afb41dd2b01acf5c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.596393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a4a056f9f304172afb41dd2b01acf5c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.598588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.606829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:34.614959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1187/2356] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:34 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:34.617798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b01f-f795-4ed4-a2a7-aa50fca6c3db admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.670455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a4a056f9f304172afb41dd2b01acf5c', 'request_id': 'req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:34.680675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a4a056f9f304172afb41dd2b01acf5c', 'request_id': 'req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:34.689151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a4a056f9f304172afb41dd2b01acf5c', 'request_id': 'req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:34.690620 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b01f-f795-4ed4-a2a7-aa50fca6c3db admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.704261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] The token cache is being invalidate because project 4a4a056f9f304172afb41dd2b01acf5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:34.704649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:34.705553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0f2270f1-03f8-47b0-81c9-05dd8a75bf22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:34.707763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1170/2357] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:34 2022] DELETE /identity/v3/projects/4a4a056f9f304172afb41dd2b01acf5c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:34.715200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa0cf7-91f2-48a0-babd-5708bca540b5 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.715504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa0cf7-91f2-48a0-babd-5708bca540b5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.715790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fa0cf7-91f2-48a0-babd-5708bca540b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.738797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-c8fa0cf7-91f2-48a0-babd-5708bca540b5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:34.740084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c8fa0cf7-91f2-48a0-babd-5708bca540b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:34.760278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754299b0-3dc5-457b-b4cf-adf8b645c7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.761197 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754299b0-3dc5-457b-b4cf-adf8b645c7fc admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.762454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754299b0-3dc5-457b-b4cf-adf8b645c7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.762834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754299b0-3dc5-457b-b4cf-adf8b645c7fc admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.763590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754299b0-3dc5-457b-b4cf-adf8b645c7fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.765699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754299b0-3dc5-457b-b4cf-adf8b645c7fc admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.797006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1188/2358] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:34 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:34.798091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754299b0-3dc5-457b-b4cf-adf8b645c7fc admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.799812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-754299b0-3dc5-457b-b4cf-adf8b645c7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:34.807263 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1171/2359] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:34.814862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754299b0-3dc5-457b-b4cf-adf8b645c7fc admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.817362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33fd93-8ab8-4880-acca-deda08650e2d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.818123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33fd93-8ab8-4880-acca-deda08650e2d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.818686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33fd93-8ab8-4880-acca-deda08650e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.819880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38c13-e9d0-4bc0-a742-2a4ab0536a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.820486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38c13-e9d0-4bc0-a742-2a4ab0536a96 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.820763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38c13-e9d0-4bc0-a742-2a4ab0536a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.821035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e38c13-e9d0-4bc0-a742-2a4ab0536a96 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.821724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e38c13-e9d0-4bc0-a742-2a4ab0536a96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.823324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e38c13-e9d0-4bc0-a742-2a4ab0536a96 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.835442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1189/2360] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:34.840069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38c13-e9d0-4bc0-a742-2a4ab0536a96 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.845828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-ce33fd93-8ab8-4880-acca-deda08650e2d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:34.847131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ce33fd93-8ab8-4880-acca-deda08650e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:34.852600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e38c13-e9d0-4bc0-a742-2a4ab0536a96 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.855711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1172/2361] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:34.857696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b1f8-f3f9-4d5d-abeb-799de492535c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.858352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b1f8-f3f9-4d5d-abeb-799de492535c admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.858813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b1f8-f3f9-4d5d-abeb-799de492535c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.859063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6810b1f8-f3f9-4d5d-abeb-799de492535c admin admin] PATH_INFO: `/v3/projects/5ae057d2aa9e421ebc9ac56e0fe07cd5/users/346b8321e980458285d14f43631c2a67/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.859830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33fd93-8ab8-4880-acca-deda08650e2d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.871080 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33fd93-8ab8-4880-acca-deda08650e2d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.875032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810b1f8-f3f9-4d5d-abeb-799de492535c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae057d2aa9e421ebc9ac56e0fe07cd5, user_id=346b8321e980458285d14f43631c2a67, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.876414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3028614-60d4-4d12-a886-cd8d1c86c393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.877086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3028614-60d4-4d12-a886-cd8d1c86c393 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.877524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3028614-60d4-4d12-a886-cd8d1c86c393 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.877713 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6810b1f8-f3f9-4d5d-abeb-799de492535c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.878594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3028614-60d4-4d12-a886-cd8d1c86c393 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.878736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3028614-60d4-4d12-a886-cd8d1c86c393 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:54:34.879107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3028614-60d4-4d12-a886-cd8d1c86c393 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.880823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3028614-60d4-4d12-a886-cd8d1c86c393 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.894642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1190/2362] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:34 2022] PUT /identity/v3/projects/5ae057d2aa9e421ebc9ac56e0fe07cd5/users/346b8321e980458285d14f43631c2a67/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:34.898097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1173/2363] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:54:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:54:34.898886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b1f8-f3f9-4d5d-abeb-799de492535c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.899088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3028614-60d4-4d12-a886-cd8d1c86c393 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:34.910009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3028614-60d4-4d12-a886-cd8d1c86c393 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.922616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:34.983335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6810b1f8-f3f9-4d5d-abeb-799de492535c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:34.984629 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bf377-3941-4d04-abb6-22ded454e5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.985484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf377-3941-4d04-abb6-22ded454e5c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.985852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf377-3941-4d04-abb6-22ded454e5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.986131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53bf377-3941-4d04-abb6-22ded454e5c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.986854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53bf377-3941-4d04-abb6-22ded454e5c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.988733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac47e66-4836-4c03-bd0a-1471752ef88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:34.989050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53bf377-3941-4d04-abb6-22ded454e5c9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:34.989775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac47e66-4836-4c03-bd0a-1471752ef88e admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:34.990014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac47e66-4836-4c03-bd0a-1471752ef88e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:34.990371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac47e66-4836-4c03-bd0a-1471752ef88e admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:34.991145 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac47e66-4836-4c03-bd0a-1471752ef88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:34.992839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac47e66-4836-4c03-bd0a-1471752ef88e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.006509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1191/2364] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:34 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:35.007933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac47e66-4836-4c03-bd0a-1471752ef88e admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.012102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:35.019038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac47e66-4836-4c03-bd0a-1471752ef88e admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.024046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1174/2365] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:34 2022] POST /identity/v3/projects => generated 391 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:35.024752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bf377-3941-4d04-abb6-22ded454e5c9 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.078836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5479c3-69e0-4e90-806c-98ffdbf445a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.079502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5479c3-69e0-4e90-806c-98ffdbf445a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.079901 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5479c3-69e0-4e90-806c-98ffdbf445a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.080183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5479c3-69e0-4e90-806c-98ffdbf445a6 admin admin] PATH_INFO: `/v3/projects/5ae057d2aa9e421ebc9ac56e0fe07cd5/users/346b8321e980458285d14f43631c2a67/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.082114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5479c3-69e0-4e90-806c-98ffdbf445a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae057d2aa9e421ebc9ac56e0fe07cd5, user_id=346b8321e980458285d14f43631c2a67, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.084823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5479c3-69e0-4e90-806c-98ffdbf445a6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.087904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53bf377-3941-4d04-abb6-22ded454e5c9 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.092606 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bd0be-fdae-4f15-ac3f-f496556cd230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.093205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bd0be-fdae-4f15-ac3f-f496556cd230 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.093509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bd0be-fdae-4f15-ac3f-f496556cd230 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.093784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82bd0be-fdae-4f15-ac3f-f496556cd230 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.094421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bd0be-fdae-4f15-ac3f-f496556cd230 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.095609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1192/2366] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:35 2022] PUT /identity/v3/projects/5ae057d2aa9e421ebc9ac56e0fe07cd5/users/346b8321e980458285d14f43631c2a67/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:35.096307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82bd0be-fdae-4f15-ac3f-f496556cd230 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.108335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee864-7d16-42ab-b8cf-b00cef1c61d2 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.109017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee864-7d16-42ab-b8cf-b00cef1c61d2 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.109350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ee864-7d16-42ab-b8cf-b00cef1c61d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.122273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1175/2367] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:35 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:35.123317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bd0be-fdae-4f15-ac3f-f496556cd230 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.133122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82bd0be-fdae-4f15-ac3f-f496556cd230 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.139837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-284ee864-7d16-42ab-b8cf-b00cef1c61d2 None None] MFA Rules not processed for user `346b8321e980458285d14f43631c2a67`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:35.141121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-284ee864-7d16-42ab-b8cf-b00cef1c61d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:35.189736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d70ab-d998-4339-9269-1d2a3b7dd8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.190355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d70ab-d998-4339-9269-1d2a3b7dd8e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.190635 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d70ab-d998-4339-9269-1d2a3b7dd8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.190957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2d70ab-d998-4339-9269-1d2a3b7dd8e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.191632 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d70ab-d998-4339-9269-1d2a3b7dd8e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.193315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2d70ab-d998-4339-9269-1d2a3b7dd8e6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.204039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1176/2368] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:35.207985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d70ab-d998-4339-9269-1d2a3b7dd8e6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.211279 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1193/2369] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:35.218305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2d70ab-d998-4339-9269-1d2a3b7dd8e6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.222332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ee864-7d16-42ab-b8cf-b00cef1c61d2 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.223219 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870e00-1e78-4e00-b31f-bdfc6be913f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.223662 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-284ee864-7d16-42ab-b8cf-b00cef1c61d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:35.223844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870e00-1e78-4e00-b31f-bdfc6be913f6 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.224101 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870e00-1e78-4e00-b31f-bdfc6be913f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.224376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e870e00-1e78-4e00-b31f-bdfc6be913f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.225088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e870e00-1e78-4e00-b31f-bdfc6be913f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.226663 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e870e00-1e78-4e00-b31f-bdfc6be913f6 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.237883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1177/2370] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:35.242027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870e00-1e78-4e00-b31f-bdfc6be913f6 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.251893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e870e00-1e78-4e00-b31f-bdfc6be913f6 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.256469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6383bddb-7e33-40fe-8fb1-a42d2dd5d592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.257104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383bddb-7e33-40fe-8fb1-a42d2dd5d592 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.257430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383bddb-7e33-40fe-8fb1-a42d2dd5d592 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.257754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6383bddb-7e33-40fe-8fb1-a42d2dd5d592 admin admin] PATH_INFO: `/v3/projects/09904b9e5502404c8e2352be518d0356/users/932a20957b8c49a7989f4a6d6b637881/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.258918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:35.275009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383bddb-7e33-40fe-8fb1-a42d2dd5d592 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09904b9e5502404c8e2352be518d0356, user_id=932a20957b8c49a7989f4a6d6b637881, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.277933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6383bddb-7e33-40fe-8fb1-a42d2dd5d592 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.284626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ee864-7d16-42ab-b8cf-b00cef1c61d2 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.288500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee00a73-f8cc-474b-851d-96d667fb7ead service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.289109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee00a73-f8cc-474b-851d-96d667fb7ead service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.289389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee00a73-f8cc-474b-851d-96d667fb7ead service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.289696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee00a73-f8cc-474b-851d-96d667fb7ead service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.291625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1178/2371] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:35 2022] PUT /identity/v3/projects/09904b9e5502404c8e2352be518d0356/users/932a20957b8c49a7989f4a6d6b637881/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:35.300711 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee00a73-f8cc-474b-851d-96d667fb7ead service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.301727 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19059ea-9825-456f-96fe-1b2528cec106 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.302015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19059ea-9825-456f-96fe-1b2528cec106 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.302204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee00a73-f8cc-474b-851d-96d667fb7ead service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.302323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19059ea-9825-456f-96fe-1b2528cec106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.312389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1194/2372] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:35.330321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f19059ea-9825-456f-96fe-1b2528cec106 None None] MFA Rules not processed for user `932a20957b8c49a7989f4a6d6b637881`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:35.331531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f19059ea-9825-456f-96fe-1b2528cec106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:35.372968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:35.402742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1179/2373] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:35.404048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee00a73-f8cc-474b-851d-96d667fb7ead service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.417173 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee00a73-f8cc-474b-851d-96d667fb7ead service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.476813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27625abe-1e46-4bcc-9561-15d1e05b959c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.477444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27625abe-1e46-4bcc-9561-15d1e05b959c admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.477726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27625abe-1e46-4bcc-9561-15d1e05b959c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.477994 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27625abe-1e46-4bcc-9561-15d1e05b959c admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.478845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27625abe-1e46-4bcc-9561-15d1e05b959c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.481256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27625abe-1e46-4bcc-9561-15d1e05b959c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.512122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1195/2374] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:35 2022] POST /identity/v3/projects => generated 393 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:35.513229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19059ea-9825-456f-96fe-1b2528cec106 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.524957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19059ea-9825-456f-96fe-1b2528cec106 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.590229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68f92c-da38-4477-8609-04d81a54c65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.591122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68f92c-da38-4477-8609-04d81a54c65c admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.591610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68f92c-da38-4477-8609-04d81a54c65c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.591761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff68f92c-da38-4477-8609-04d81a54c65c admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.592404 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68f92c-da38-4477-8609-04d81a54c65c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.594374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff68f92c-da38-4477-8609-04d81a54c65c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.619684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1180/2375] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:35 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:35.621980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27625abe-1e46-4bcc-9561-15d1e05b959c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.637346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27625abe-1e46-4bcc-9561-15d1e05b959c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.641435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb8e6a-5aa4-4030-b179-da442b70f88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.642082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8e6a-5aa4-4030-b179-da442b70f88e admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.642361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8e6a-5aa4-4030-b179-da442b70f88e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.642686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb8e6a-5aa4-4030-b179-da442b70f88e admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.643264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb8e6a-5aa4-4030-b179-da442b70f88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.644847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb8e6a-5aa4-4030-b179-da442b70f88e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.656005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1196/2376] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:35.661605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68f92c-da38-4477-8609-04d81a54c65c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.672015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff68f92c-da38-4477-8609-04d81a54c65c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.676635 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6b7f-cddc-460d-a42d-e415a08e1fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.677302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6b7f-cddc-460d-a42d-e415a08e1fa7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.677620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6b7f-cddc-460d-a42d-e415a08e1fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.677897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137c6b7f-cddc-460d-a42d-e415a08e1fa7 admin admin] PATH_INFO: `/v3/projects/cc5e2b3d16ad49a09ea5325e501a93f0/users/1b2dbb7c001740028de5bf54b9c3f7b2/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.693525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c6b7f-cddc-460d-a42d-e415a08e1fa7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5e2b3d16ad49a09ea5325e501a93f0, user_id=1b2dbb7c001740028de5bf54b9c3f7b2, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.696248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137c6b7f-cddc-460d-a42d-e415a08e1fa7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.710077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1181/2377] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:35 2022] PUT /identity/v3/projects/cc5e2b3d16ad49a09ea5325e501a93f0/users/1b2dbb7c001740028de5bf54b9c3f7b2/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:35.718453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb8e6a-5aa4-4030-b179-da442b70f88e admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.721177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6b7f-cddc-460d-a42d-e415a08e1fa7 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.725669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb8e6a-5aa4-4030-b179-da442b70f88e admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.781285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b381a-5849-4989-af72-048f1aaa3cb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.781837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b381a-5849-4989-af72-048f1aaa3cb0 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.782116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b381a-5849-4989-af72-048f1aaa3cb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.782383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b381a-5849-4989-af72-048f1aaa3cb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.783015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b381a-5849-4989-af72-048f1aaa3cb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.784587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b381a-5849-4989-af72-048f1aaa3cb0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.785451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137c6b7f-cddc-460d-a42d-e415a08e1fa7 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.790133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.790749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.791022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.791294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] PATH_INFO: `/v3/users/855a1018d9794be99c51fbed6e4f482a` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.792457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=855a1018d9794be99c51fbed6e4f482a)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.795086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.797006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1197/2378] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:35.801106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b381a-5849-4989-af72-048f1aaa3cb0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.810946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b381a-5849-4989-af72-048f1aaa3cb0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:35.815646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f0cc27-9a89-4be8-b9e1-b69085a87db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:35.816280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0cc27-9a89-4be8-b9e1-b69085a87db1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.816573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0cc27-9a89-4be8-b9e1-b69085a87db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.816861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f0cc27-9a89-4be8-b9e1-b69085a87db1 admin admin] PATH_INFO: `/v3/projects/cc5e2b3d16ad49a09ea5325e501a93f0/users/1b2dbb7c001740028de5bf54b9c3f7b2/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.818938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0cc27-9a89-4be8-b9e1-b69085a87db1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc5e2b3d16ad49a09ea5325e501a93f0, user_id=1b2dbb7c001740028de5bf54b9c3f7b2, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:35.821885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f0cc27-9a89-4be8-b9e1-b69085a87db1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:35.833211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1198/2379] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:35 2022] PUT /identity/v3/projects/cc5e2b3d16ad49a09ea5325e501a93f0/users/1b2dbb7c001740028de5bf54b9c3f7b2/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:35.844002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855a1018d9794be99c51fbed6e4f482a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:35.844347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23607f-8d83-412f-b77d-23b50e198703 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.844636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23607f-8d83-412f-b77d-23b50e198703 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.844967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23607f-8d83-412f-b77d-23b50e198703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.845687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:35.852341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855a1018d9794be99c51fbed6e4f482a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:35.853709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855a1018d9794be99c51fbed6e4f482a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:35.868659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855a1018d9794be99c51fbed6e4f482a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:35.875334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ab23607f-8d83-412f-b77d-23b50e198703 None None] MFA Rules not processed for user `1b2dbb7c001740028de5bf54b9c3f7b2`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:35.875642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d2d2dd06-eee0-46da-9a9f-569e2633d8bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855a1018d9794be99c51fbed6e4f482a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:35.876566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ab23607f-8d83-412f-b77d-23b50e198703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:35.881660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1182/2380] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:35 2022] DELETE /identity/v3/users/855a1018d9794be99c51fbed6e4f482a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:35.885906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e8d74-541d-49e3-a685-8d134ea729b4 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:35.886235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e8d74-541d-49e3-a685-8d134ea729b4 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:35.886512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e8d74-541d-49e3-a685-8d134ea729b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:35.898513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:35.905953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d66e8d74-541d-49e3-a685-8d134ea729b4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:35.907246 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d66e8d74-541d-49e3-a685-8d134ea729b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:35.949447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1199/2381] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:35.960088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23607f-8d83-412f-b77d-23b50e198703 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.961684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ab23607f-8d83-412f-b77d-23b50e198703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:35.968958 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1183/2382] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:35.979187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e8d74-541d-49e3-a685-8d134ea729b4 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:35.981205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d66e8d74-541d-49e3-a685-8d134ea729b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:36.021177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23607f-8d83-412f-b77d-23b50e198703 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:36.044392 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e8d74-541d-49e3-a685-8d134ea729b4 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:36.048744 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24cbd6-d65f-426f-bf67-9427a0957e7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:36.049361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24cbd6-d65f-426f-bf67-9427a0957e7b service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:36.049670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24cbd6-d65f-426f-bf67-9427a0957e7b service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:36.050325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f24cbd6-d65f-426f-bf67-9427a0957e7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:36.061036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24cbd6-d65f-426f-bf67-9427a0957e7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:36.062513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f24cbd6-d65f-426f-bf67-9427a0957e7b service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:36.075098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1184/2383] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:36.079467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336ad9-9ea6-486d-8881-386da176f341 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:36.080502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336ad9-9ea6-486d-8881-386da176f341 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:36.081140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336ad9-9ea6-486d-8881-386da176f341 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:36.081691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e336ad9-9ea6-486d-8881-386da176f341 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:36.148552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e336ad9-9ea6-486d-8881-386da176f341 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:36.150036 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e336ad9-9ea6-486d-8881-386da176f341 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:36.161134 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1200/2384] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:35 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:36.215481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24cbd6-d65f-426f-bf67-9427a0957e7b service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:36.216878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3f24cbd6-d65f-426f-bf67-9427a0957e7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:36.229846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f24cbd6-d65f-426f-bf67-9427a0957e7b service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:36.233649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c23ee2-0d59-4b3a-96ec-fb3f1b18eeac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:36.234249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c23ee2-0d59-4b3a-96ec-fb3f1b18eeac service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:36.234525 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c23ee2-0d59-4b3a-96ec-fb3f1b18eeac service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:36.234795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c23ee2-0d59-4b3a-96ec-fb3f1b18eeac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:36.236527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-28c23ee2-0d59-4b3a-96ec-fb3f1b18eeac service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:36.300647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c23ee2-0d59-4b3a-96ec-fb3f1b18eeac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:36.302201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c23ee2-0d59-4b3a-96ec-fb3f1b18eeac service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:36.311333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1185/2385] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:36.413518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336ad9-9ea6-486d-8881-386da176f341 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:36.417941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5e336ad9-9ea6-486d-8881-386da176f341 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:36.429562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e336ad9-9ea6-486d-8881-386da176f341 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:36.438002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:36.438652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:36.438932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:36.439202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] PATH_INFO: `/v3/projects/0a6c602ddf9e49a299b8ec65ef61aee1` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:36.443082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a6c602ddf9e49a299b8ec65ef61aee1)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:36.445002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:36.468631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:36.506439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a6c602ddf9e49a299b8ec65ef61aee1', 'request_id': 'req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.516726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a6c602ddf9e49a299b8ec65ef61aee1', 'request_id': 'req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.524379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a6c602ddf9e49a299b8ec65ef61aee1', 'request_id': 'req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.535749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] The token cache is being invalidate because project 0a6c602ddf9e49a299b8ec65ef61aee1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:36.536159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.536703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.539112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1201/2386] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:36 2022] DELETE /identity/v3/projects/0a6c602ddf9e49a299b8ec65ef61aee1 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:36.543121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c23ee2-0d59-4b3a-96ec-fb3f1b18eeac service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:36.556699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c23ee2-0d59-4b3a-96ec-fb3f1b18eeac service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:36.561689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:36.631421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:36.632069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:36.632350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:36.632628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] PATH_INFO: `/v3/users/346b8321e980458285d14f43631c2a67` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:36.633889 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=346b8321e980458285d14f43631c2a67)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:36.636044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:36.695011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346b8321e980458285d14f43631c2a67'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.702187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346b8321e980458285d14f43631c2a67'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.702821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346b8321e980458285d14f43631c2a67'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.716694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346b8321e980458285d14f43631c2a67'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.725019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3b8e44e0-9637-49d6-af9e-55cba8c004c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346b8321e980458285d14f43631c2a67'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:36.731892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1186/2387] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:36 2022] DELETE /identity/v3/users/346b8321e980458285d14f43631c2a67 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:37.232551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:37.234087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:37.247408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87b50bb-fc95-44bc-9c2f-c8594e94b32b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:37.308422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:37.309062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.309344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.309658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] PATH_INFO: `/v3/projects/5ae057d2aa9e421ebc9ac56e0fe07cd5` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:37.310804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae057d2aa9e421ebc9ac56e0fe07cd5)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:37.312740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:37.362486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae057d2aa9e421ebc9ac56e0fe07cd5', 'request_id': 'req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:37.369990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae057d2aa9e421ebc9ac56e0fe07cd5', 'request_id': 'req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:37.376313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae057d2aa9e421ebc9ac56e0fe07cd5', 'request_id': 'req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:37.388017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] The token cache is being invalidate because project 5ae057d2aa9e421ebc9ac56e0fe07cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:37.388312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:37.388983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5559e0ee-8ebc-4cad-a1f9-3a68fd23df7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:37.390518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1202/2388] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:37 2022] DELETE /identity/v3/projects/5ae057d2aa9e421ebc9ac56e0fe07cd5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:37.395513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a3bac-dcef-4659-9679-dd6b9228feca None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.395965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a3bac-dcef-4659-9679-dd6b9228feca None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.396254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a3bac-dcef-4659-9679-dd6b9228feca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:37.416572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-a60a3bac-dcef-4659-9679-dd6b9228feca None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:37.418453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a60a3bac-dcef-4659-9679-dd6b9228feca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:37.481706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1187/2389] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:37.489352 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8e6e-0956-4316-8926-5ebd001d8ad9 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.489677 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8e6e-0956-4316-8926-5ebd001d8ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.489955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ba8e6e-0956-4316-8926-5ebd001d8ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:37.514532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-06ba8e6e-0956-4316-8926-5ebd001d8ad9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:37.515869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-06ba8e6e-0956-4316-8926-5ebd001d8ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:37.524094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1203/2390] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:37.529016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a3bac-dcef-4659-9679-dd6b9228feca None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:37.538994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60a3bac-dcef-4659-9679-dd6b9228feca None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:37.544350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fb5d0-0d1b-4708-9fa9-0c38cb14a2bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:37.544961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fb5d0-0d1b-4708-9fa9-0c38cb14a2bd admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.545242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fb5d0-0d1b-4708-9fa9-0c38cb14a2bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.545557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3fb5d0-0d1b-4708-9fa9-0c38cb14a2bd admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:37.546218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fb5d0-0d1b-4708-9fa9-0c38cb14a2bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:54:37.546526 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fb5d0-0d1b-4708-9fa9-0c38cb14a2bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:37.548127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3fb5d0-0d1b-4708-9fa9-0c38cb14a2bd admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:37.561236 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1188/2391] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:54:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:54:37.568251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba8e6e-0956-4316-8926-5ebd001d8ad9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:37.578645 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ba8e6e-0956-4316-8926-5ebd001d8ad9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:37.583642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c6951-c2f3-435f-9c48-76106f7522b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:37.584293 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c6951-c2f3-435f-9c48-76106f7522b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.584577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c6951-c2f3-435f-9c48-76106f7522b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.584848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0c6951-c2f3-435f-9c48-76106f7522b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:37.585507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c6951-c2f3-435f-9c48-76106f7522b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:37.587660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0c6951-c2f3-435f-9c48-76106f7522b0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:37.615213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1204/2392] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:37 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:37.619379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fb5d0-0d1b-4708-9fa9-0c38cb14a2bd admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:37.630212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3fb5d0-0d1b-4708-9fa9-0c38cb14a2bd admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:37.639047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:37.697186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b307c-b680-4496-a871-365dca4c41d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:37.697946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b307c-b680-4496-a871-365dca4c41d9 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.698361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b307c-b680-4496-a871-365dca4c41d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.699320 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266b307c-b680-4496-a871-365dca4c41d9 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:37.699766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b307c-b680-4496-a871-365dca4c41d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:37.702387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266b307c-b680-4496-a871-365dca4c41d9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:37.745438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1189/2393] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:37 2022] POST /identity/v3/users => generated 283 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:37.748980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c6951-c2f3-435f-9c48-76106f7522b0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:37.761186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0c6951-c2f3-435f-9c48-76106f7522b0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:37.768424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d62d-9d13-4c5e-b0f1-12810da74a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:37.770005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d62d-9d13-4c5e-b0f1-12810da74a6a admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.770508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d62d-9d13-4c5e-b0f1-12810da74a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.771057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed8d62d-9d13-4c5e-b0f1-12810da74a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:37.772032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8d62d-9d13-4c5e-b0f1-12810da74a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:37.774001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed8d62d-9d13-4c5e-b0f1-12810da74a6a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:37.775892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:37.793462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1205/2394] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:37.802959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b307c-b680-4496-a871-365dca4c41d9 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:37.815286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266b307c-b680-4496-a871-365dca4c41d9 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:37.820530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f8a14-40fa-410c-b732-c989c0495169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:37.821284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f8a14-40fa-410c-b732-c989c0495169 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.821698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f8a14-40fa-410c-b732-c989c0495169 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.822182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f8a14-40fa-410c-b732-c989c0495169 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:37.822960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f8a14-40fa-410c-b732-c989c0495169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:37.823410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d62d-9d13-4c5e-b0f1-12810da74a6a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:37.824948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f8a14-40fa-410c-b732-c989c0495169 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:37.826410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5ed8d62d-9d13-4c5e-b0f1-12810da74a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:37.840004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1190/2395] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:37 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:37.843647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f8a14-40fa-410c-b732-c989c0495169 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:37.869677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f8a14-40fa-410c-b732-c989c0495169 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:37.897558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e84fed8-7984-4bf6-a8a5-aa74404a8814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:37.898248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84fed8-7984-4bf6-a8a5-aa74404a8814 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.898532 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84fed8-7984-4bf6-a8a5-aa74404a8814 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.898810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e84fed8-7984-4bf6-a8a5-aa74404a8814 admin admin] PATH_INFO: `/v3/projects/ddc2cacebb7a43eaa599414527fdebe4/users/37cbddfb1f714d2eb8c0c7978f7cc532/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:37.925282 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84fed8-7984-4bf6-a8a5-aa74404a8814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddc2cacebb7a43eaa599414527fdebe4, user_id=37cbddfb1f714d2eb8c0c7978f7cc532, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:37.928643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e84fed8-7984-4bf6-a8a5-aa74404a8814 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:37.947858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed8d62d-9d13-4c5e-b0f1-12810da74a6a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:37.952135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1191/2396] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:37 2022] PUT /identity/v3/projects/ddc2cacebb7a43eaa599414527fdebe4/users/37cbddfb1f714d2eb8c0c7978f7cc532/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:37.963788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81604d0-9ec2-4134-b66d-2459dbd05b05 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:37.964763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81604d0-9ec2-4134-b66d-2459dbd05b05 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:37.965042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81604d0-9ec2-4134-b66d-2459dbd05b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.005902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f81604d0-9ec2-4134-b66d-2459dbd05b05 None None] MFA Rules not processed for user `37cbddfb1f714d2eb8c0c7978f7cc532`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:38.007258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f81604d0-9ec2-4134-b66d-2459dbd05b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:38.039376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f21c1-f135-4f8c-8688-bfea2f52a8a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.040100 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f21c1-f135-4f8c-8688-bfea2f52a8a6 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.040265 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f21c1-f135-4f8c-8688-bfea2f52a8a6 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.040541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531f21c1-f135-4f8c-8688-bfea2f52a8a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.043878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-531f21c1-f135-4f8c-8688-bfea2f52a8a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:38.057497 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f21c1-f135-4f8c-8688-bfea2f52a8a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:38.060114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531f21c1-f135-4f8c-8688-bfea2f52a8a6 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:38.072257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1206/2397] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:38.104564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1192/2398] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:38.109123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f21c1-f135-4f8c-8688-bfea2f52a8a6 service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.179423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531f21c1-f135-4f8c-8688-bfea2f52a8a6 service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:38.184681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa804-c7a9-4082-bb80-8ba363db4383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.185294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa804-c7a9-4082-bb80-8ba363db4383 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.185609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa804-c7a9-4082-bb80-8ba363db4383 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.185944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfa804-c7a9-4082-bb80-8ba363db4383 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.186660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfa804-c7a9-4082-bb80-8ba363db4383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:38.189231 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfa804-c7a9-4082-bb80-8ba363db4383 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:38.222213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1207/2399] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:38 2022] POST /identity/v3/projects => generated 363 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:38.226561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81604d0-9ec2-4134-b66d-2459dbd05b05 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.242658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81604d0-9ec2-4134-b66d-2459dbd05b05 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:38.308650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:38.316031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c072a-2963-4148-92eb-6181caab64e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.316797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c072a-2963-4148-92eb-6181caab64e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.317167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c072a-2963-4148-92eb-6181caab64e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.317371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c072a-2963-4148-92eb-6181caab64e0 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.318040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c072a-2963-4148-92eb-6181caab64e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:38.321084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c072a-2963-4148-92eb-6181caab64e0 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:38.346161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1193/2400] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:38 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:38.350271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa804-c7a9-4082-bb80-8ba363db4383 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.357660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:38.361921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfa804-c7a9-4082-bb80-8ba363db4383 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:38.368945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b0808-ca6d-4700-a5d1-cd1e9e096238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.369681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b0808-ca6d-4700-a5d1-cd1e9e096238 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.370029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b0808-ca6d-4700-a5d1-cd1e9e096238 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.370378 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b0808-ca6d-4700-a5d1-cd1e9e096238 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.371974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b0808-ca6d-4700-a5d1-cd1e9e096238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:38.374276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b0808-ca6d-4700-a5d1-cd1e9e096238 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:38.386436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1208/2401] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:38.390382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c072a-2963-4148-92eb-6181caab64e0 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.400779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c072a-2963-4148-92eb-6181caab64e0 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:38.405923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435f90b-4369-44e1-b109-153d2b9bac1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.406649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435f90b-4369-44e1-b109-153d2b9bac1b admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.406842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435f90b-4369-44e1-b109-153d2b9bac1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.407118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3435f90b-4369-44e1-b109-153d2b9bac1b admin admin] PATH_INFO: `/v3/projects/69def2a3ee0440f4924e297c37bf66c1/users/ef507bb8411d4150a12c5b1d531a3366/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.424681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435f90b-4369-44e1-b109-153d2b9bac1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69def2a3ee0440f4924e297c37bf66c1, user_id=ef507bb8411d4150a12c5b1d531a3366, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:38.427513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3435f90b-4369-44e1-b109-153d2b9bac1b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:38.445470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1194/2402] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:38 2022] PUT /identity/v3/projects/69def2a3ee0440f4924e297c37bf66c1/users/ef507bb8411d4150a12c5b1d531a3366/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:38.447626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b0808-ca6d-4700-a5d1-cd1e9e096238 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.455903 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435f90b-4369-44e1-b109-153d2b9bac1b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.457949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3435f90b-4369-44e1-b109-153d2b9bac1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:38.458646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b0808-ca6d-4700-a5d1-cd1e9e096238 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:38.527106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3435f90b-4369-44e1-b109-153d2b9bac1b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:38.531064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d564cea0-adcf-44d5-ba1c-a5dc282646ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.531682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564cea0-adcf-44d5-ba1c-a5dc282646ca service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.532090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564cea0-adcf-44d5-ba1c-a5dc282646ca service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.532377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d564cea0-adcf-44d5-ba1c-a5dc282646ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.532628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f9d9-717f-46cc-91aa-b54000f90920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.533232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f9d9-717f-46cc-91aa-b54000f90920 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.533546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f9d9-717f-46cc-91aa-b54000f90920 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.533938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f9d9-717f-46cc-91aa-b54000f90920 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.534195 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d564cea0-adcf-44d5-ba1c-a5dc282646ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:38.534586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4f9d9-717f-46cc-91aa-b54000f90920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:38.536209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4f9d9-717f-46cc-91aa-b54000f90920 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:38.545090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564cea0-adcf-44d5-ba1c-a5dc282646ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:38.546598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d564cea0-adcf-44d5-ba1c-a5dc282646ca service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:38.548665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1209/2403] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:38 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:38.552648 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f9d9-717f-46cc-91aa-b54000f90920 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.559741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1195/2404] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:38.569196 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f9d9-717f-46cc-91aa-b54000f90920 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:38.573526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744519fd-9820-4103-85ca-dd9d01972e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.574535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744519fd-9820-4103-85ca-dd9d01972e3b admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.574815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744519fd-9820-4103-85ca-dd9d01972e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.575084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744519fd-9820-4103-85ca-dd9d01972e3b admin admin] PATH_INFO: `/v3/projects/69def2a3ee0440f4924e297c37bf66c1/users/ef507bb8411d4150a12c5b1d531a3366/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.577179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744519fd-9820-4103-85ca-dd9d01972e3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=69def2a3ee0440f4924e297c37bf66c1, user_id=ef507bb8411d4150a12c5b1d531a3366, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:38.579903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744519fd-9820-4103-85ca-dd9d01972e3b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:38.591907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1210/2405] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:38 2022] PUT /identity/v3/projects/69def2a3ee0440f4924e297c37bf66c1/users/ef507bb8411d4150a12c5b1d531a3366/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:38.603356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d1d0-8abe-43ad-8089-6374568df1b8 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.603878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d1d0-8abe-43ad-8089-6374568df1b8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.604174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0d1d0-8abe-43ad-8089-6374568df1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.636575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-36a0d1d0-8abe-43ad-8089-6374568df1b8 None None] MFA Rules not processed for user `ef507bb8411d4150a12c5b1d531a3366`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:38.638209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-36a0d1d0-8abe-43ad-8089-6374568df1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:38.762290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1196/2406] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:38.771107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744519fd-9820-4103-85ca-dd9d01972e3b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.772985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-744519fd-9820-4103-85ca-dd9d01972e3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:38.857874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744519fd-9820-4103-85ca-dd9d01972e3b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:38.861934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43460088-ec50-4780-bd8e-b9796f5e7bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.862558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43460088-ec50-4780-bd8e-b9796f5e7bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.862835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43460088-ec50-4780-bd8e-b9796f5e7bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.863106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43460088-ec50-4780-bd8e-b9796f5e7bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:38.873055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43460088-ec50-4780-bd8e-b9796f5e7bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:38.874685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43460088-ec50-4780-bd8e-b9796f5e7bf5 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:38.886505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1211/2407] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:38.965576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d1d0-8abe-43ad-8089-6374568df1b8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.966651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-36a0d1d0-8abe-43ad-8089-6374568df1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:38.977369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43460088-ec50-4780-bd8e-b9796f5e7bf5 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:38.987003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43460088-ec50-4780-bd8e-b9796f5e7bf5 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:38.990830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa0eea-f4a8-4a2d-aab9-32df811e3c0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:38.991500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa0eea-f4a8-4a2d-aab9-32df811e3c0f service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:38.991883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa0eea-f4a8-4a2d-aab9-32df811e3c0f service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:38.992333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa0eea-f4a8-4a2d-aab9-32df811e3c0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:39.019799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:39.039222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0d1d0-8abe-43ad-8089-6374568df1b8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:39.044842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591566c-a42b-479b-a5ae-459ccee1b900 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:39.045573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591566c-a42b-479b-a5ae-459ccee1b900 service placement] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:39.045912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591566c-a42b-479b-a5ae-459ccee1b900 service placement] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:39.046253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591566c-a42b-479b-a5ae-459ccee1b900 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:39.047963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-c591566c-a42b-479b-a5ae-459ccee1b900 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:39.053825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa0eea-f4a8-4a2d-aab9-32df811e3c0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:39.055270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa0eea-f4a8-4a2d-aab9-32df811e3c0f service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:39.059252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591566c-a42b-479b-a5ae-459ccee1b900 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:39.060833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591566c-a42b-479b-a5ae-459ccee1b900 service placement] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:39.064399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1212/2408] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:39.071903 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1197/2409] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:39.982019 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa0eea-f4a8-4a2d-aab9-32df811e3c0f service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:39.983494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b8fa0eea-f4a8-4a2d-aab9-32df811e3c0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:40.007571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:40.069225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa0eea-f4a8-4a2d-aab9-32df811e3c0f service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:40.073827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:40.074460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:40.074741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:40.075013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] PATH_INFO: `/v3/users/932a20957b8c49a7989f4a6d6b637881` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:40.076171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932a20957b8c49a7989f4a6d6b637881)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:40.078131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:40.138403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932a20957b8c49a7989f4a6d6b637881'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.145996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932a20957b8c49a7989f4a6d6b637881'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.146606 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932a20957b8c49a7989f4a6d6b637881'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.154972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932a20957b8c49a7989f4a6d6b637881'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.167221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932a20957b8c49a7989f4a6d6b637881'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.173700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1213/2410] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:39 2022] DELETE /identity/v3/users/932a20957b8c49a7989f4a6d6b637881 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:40.178781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81d71e-ef4a-4f99-88a7-20847bebc614 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:40.179250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81d71e-ef4a-4f99-88a7-20847bebc614 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:40.179370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81d71e-ef4a-4f99-88a7-20847bebc614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:40.199026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-5b81d71e-ef4a-4f99-88a7-20847bebc614 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:40.200232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5b81d71e-ef4a-4f99-88a7-20847bebc614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:40.271607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1198/2411] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:40.288600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:40.290051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:40.356404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69614cfe-e82b-4e7b-89e1-556bed127780 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:40.360842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d775576-1d45-4f29-b5a7-844a9c6e331b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:40.361665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d775576-1d45-4f29-b5a7-844a9c6e331b service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:40.362116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d775576-1d45-4f29-b5a7-844a9c6e331b service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:40.362458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d775576-1d45-4f29-b5a7-844a9c6e331b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:40.373093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d775576-1d45-4f29-b5a7-844a9c6e331b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:40.375157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d775576-1d45-4f29-b5a7-844a9c6e331b service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:40.385474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1214/2412] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:40.703303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81d71e-ef4a-4f99-88a7-20847bebc614 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:40.704907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5b81d71e-ef4a-4f99-88a7-20847bebc614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:40.720130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b81d71e-ef4a-4f99-88a7-20847bebc614 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:40.726508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:40.727311 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:40.727812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:40.728094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] PATH_INFO: `/v3/projects/09904b9e5502404c8e2352be518d0356` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:40.729448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09904b9e5502404c8e2352be518d0356)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:40.732025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:40.781700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a9c4-5532-434a-b4fc-bcd0953ecac3 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:40.782008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a9c4-5532-434a-b4fc-bcd0953ecac3 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:40.782324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32a9c4-5532-434a-b4fc-bcd0953ecac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:40.787912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09904b9e5502404c8e2352be518d0356', 'request_id': 'req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.797749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09904b9e5502404c8e2352be518d0356', 'request_id': 'req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.804381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09904b9e5502404c8e2352be518d0356', 'request_id': 'req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.808757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6c32a9c4-5532-434a-b4fc-bcd0953ecac3 None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:40.810017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6c32a9c4-5532-434a-b4fc-bcd0953ecac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:40.817157 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] The token cache is being invalidate because project 09904b9e5502404c8e2352be518d0356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:40.817479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.818125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.819760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1199/2413] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:40 2022] DELETE /identity/v3/projects/09904b9e5502404c8e2352be518d0356 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:40.823992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:40.825283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:40.853976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:40.887069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1215/2414] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:54:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:40.903518 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d5d9a3-e0e5-4870-bd37-84a24831b2a2 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:40.904077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32a9c4-5532-434a-b4fc-bcd0953ecac3 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:40.906305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6c32a9c4-5532-434a-b4fc-bcd0953ecac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:40.910117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:40.910836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:40.911115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:40.911389 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] PATH_INFO: `/v3/users/1b2dbb7c001740028de5bf54b9c3f7b2` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:40.912809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b2dbb7c001740028de5bf54b9c3f7b2)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:40.915605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:40.921190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:40.974797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b2dbb7c001740028de5bf54b9c3f7b2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.983873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b2dbb7c001740028de5bf54b9c3f7b2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.984514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b2dbb7c001740028de5bf54b9c3f7b2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:40.997023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32a9c4-5532-434a-b4fc-bcd0953ecac3 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:41.003394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ee12d2-240d-4b85-9243-c540c74a9119 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:41.004029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee12d2-240d-4b85-9243-c540c74a9119 service swift] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:41.004323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee12d2-240d-4b85-9243-c540c74a9119 service swift] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:41.004585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ee12d2-240d-4b85-9243-c540c74a9119 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:41.006975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-74ee12d2-240d-4b85-9243-c540c74a9119 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:41.010470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b2dbb7c001740028de5bf54b9c3f7b2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:41.019646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee12d2-240d-4b85-9243-c540c74a9119 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:41.020610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b2dbb7c001740028de5bf54b9c3f7b2'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:41.022807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ee12d2-240d-4b85-9243-c540c74a9119 service swift] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:41.027698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1200/2415] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:40 2022] DELETE /identity/v3/users/1b2dbb7c001740028de5bf54b9c3f7b2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:41.039058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1216/2416] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:54:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 17 00:54:41.596761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:41.598771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:41.691840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e11fd-818f-4b06-81d2-f02b53d5aee9 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:41.705666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:41.706494 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:41.706751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:41.707069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] PATH_INFO: `/v3/projects/cc5e2b3d16ad49a09ea5325e501a93f0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:41.708290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc5e2b3d16ad49a09ea5325e501a93f0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:41.710455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:41.785947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc5e2b3d16ad49a09ea5325e501a93f0', 'request_id': 'req-cd111181-0916-45e0-8f83-ca566a127474'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:41.807502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc5e2b3d16ad49a09ea5325e501a93f0', 'request_id': 'req-cd111181-0916-45e0-8f83-ca566a127474'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:41.836306 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc5e2b3d16ad49a09ea5325e501a93f0', 'request_id': 'req-cd111181-0916-45e0-8f83-ca566a127474'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:41.854061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] The token cache is being invalidate because project cc5e2b3d16ad49a09ea5325e501a93f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:41.854857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:41.856341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-cd111181-0916-45e0-8f83-ca566a127474 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:41.861739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1201/2417] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:41 2022] DELETE /identity/v3/projects/cc5e2b3d16ad49a09ea5325e501a93f0 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:41.864161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b203-7a04-4f70-9ed7-2d38e645f05d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:41.864461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b203-7a04-4f70-9ed7-2d38e645f05d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:41.864747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f1b203-7a04-4f70-9ed7-2d38e645f05d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:41.895277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-76f1b203-7a04-4f70-9ed7-2d38e645f05d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:41.896614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-76f1b203-7a04-4f70-9ed7-2d38e645f05d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:42.007211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca937d-518e-47c8-9b4d-ce83f206e7fd None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:42.007459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1217/2418] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:42.008207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca937d-518e-47c8-9b4d-ce83f206e7fd None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:42.008207 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca937d-518e-47c8-9b4d-ce83f206e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:42.051144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e8ca937d-518e-47c8-9b4d-ce83f206e7fd None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:42.053279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e8ca937d-518e-47c8-9b4d-ce83f206e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:42.062748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1202/2419] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:42.066963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1b203-7a04-4f70-9ed7-2d38e645f05d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:42.096114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f1b203-7a04-4f70-9ed7-2d38e645f05d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:42.109986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be550a94-7828-44fb-9a63-4c9d4b0847c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:42.110906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be550a94-7828-44fb-9a63-4c9d4b0847c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:42.111400 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be550a94-7828-44fb-9a63-4c9d4b0847c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:42.111872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be550a94-7828-44fb-9a63-4c9d4b0847c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:42.112706 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be550a94-7828-44fb-9a63-4c9d4b0847c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:54:42.113437 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be550a94-7828-44fb-9a63-4c9d4b0847c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:42.115437 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be550a94-7828-44fb-9a63-4c9d4b0847c0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:42.149098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1218/2420] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:54:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:54:42.153786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca937d-518e-47c8-9b4d-ce83f206e7fd None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:42.169322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca937d-518e-47c8-9b4d-ce83f206e7fd None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:42.179200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ef7a7-4647-45a4-b9c6-23a0464e20fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:42.180461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ef7a7-4647-45a4-b9c6-23a0464e20fb admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:42.181127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ef7a7-4647-45a4-b9c6-23a0464e20fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:42.181831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ef7a7-4647-45a4-b9c6-23a0464e20fb admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:42.183630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ef7a7-4647-45a4-b9c6-23a0464e20fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:42.188586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ef7a7-4647-45a4-b9c6-23a0464e20fb admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:42.197285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:42.244878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1203/2421] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:42 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:42.251828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be550a94-7828-44fb-9a63-4c9d4b0847c0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:42.267380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be550a94-7828-44fb-9a63-4c9d4b0847c0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:42.358574 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847e5e-06b5-4cc4-b1cb-4bd398f1be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:42.359613 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847e5e-06b5-4cc4-b1cb-4bd398f1be60 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:42.359904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847e5e-06b5-4cc4-b1cb-4bd398f1be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:42.360178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9847e5e-06b5-4cc4-b1cb-4bd398f1be60 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:42.360976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9847e5e-06b5-4cc4-b1cb-4bd398f1be60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:42.364258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9847e5e-06b5-4cc4-b1cb-4bd398f1be60 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:42.379822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:42.403219 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1219/2422] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:42 2022] POST /identity/v3/users => generated 295 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:42.407759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ef7a7-4647-45a4-b9c6-23a0464e20fb admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:42.423415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ef7a7-4647-45a4-b9c6-23a0464e20fb admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:42.429179 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428afa5-dfde-4fdb-ad28-ca2db3511f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:42.429848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428afa5-dfde-4fdb-ad28-ca2db3511f9a admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:42.430228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428afa5-dfde-4fdb-ad28-ca2db3511f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:42.430406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428afa5-dfde-4fdb-ad28-ca2db3511f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:42.431289 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428afa5-dfde-4fdb-ad28-ca2db3511f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:42.434013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428afa5-dfde-4fdb-ad28-ca2db3511f9a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:42.446268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1204/2423] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:42.451577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847e5e-06b5-4cc4-b1cb-4bd398f1be60 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:42.487687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9847e5e-06b5-4cc4-b1cb-4bd398f1be60 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:42.496425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb20b0e-b134-4671-a16e-a009ed9df7c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:42.497260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb20b0e-b134-4671-a16e-a009ed9df7c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:42.497839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb20b0e-b134-4671-a16e-a009ed9df7c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:42.498309 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb20b0e-b134-4671-a16e-a009ed9df7c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:42.499126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb20b0e-b134-4671-a16e-a009ed9df7c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:42.501083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb20b0e-b134-4671-a16e-a009ed9df7c7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:42.516921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1220/2424] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:42 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:42.521373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428afa5-dfde-4fdb-ad28-ca2db3511f9a admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:42.534796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428afa5-dfde-4fdb-ad28-ca2db3511f9a admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:42.555055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ba78-5473-4908-acd2-bd20cdf5f836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:42.555674 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ba78-5473-4908-acd2-bd20cdf5f836 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:42.555955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ba78-5473-4908-acd2-bd20cdf5f836 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:42.556290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8ba78-5473-4908-acd2-bd20cdf5f836 admin admin] PATH_INFO: `/v3/projects/b3c02579415a4c499709273e2f364072/users/298bf7e80253406b88d6afd040134e19/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:42.585792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8ba78-5473-4908-acd2-bd20cdf5f836 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c02579415a4c499709273e2f364072, user_id=298bf7e80253406b88d6afd040134e19, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:42.590729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce8ba78-5473-4908-acd2-bd20cdf5f836 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:42.614567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1205/2425] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:42 2022] PUT /identity/v3/projects/b3c02579415a4c499709273e2f364072/users/298bf7e80253406b88d6afd040134e19/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:42.625436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c794112-0ab4-4808-a700-4f53c2d9c5fd None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:42.625892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c794112-0ab4-4808-a700-4f53c2d9c5fd None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:42.626172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c794112-0ab4-4808-a700-4f53c2d9c5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:42.716283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2c794112-0ab4-4808-a700-4f53c2d9c5fd None None] MFA Rules not processed for user `298bf7e80253406b88d6afd040134e19`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:42.718401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2c794112-0ab4-4808-a700-4f53c2d9c5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:42.837302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1221/2426] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:42.842582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ba78-5473-4908-acd2-bd20cdf5f836 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:43.017882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8ba78-5473-4908-acd2-bd20cdf5f836 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:43.030167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b2df5-f39e-4c6f-aa72-78ead1367a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:43.031483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b2df5-f39e-4c6f-aa72-78ead1367a6f admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:43.032020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b2df5-f39e-4c6f-aa72-78ead1367a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:43.032873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44b2df5-f39e-4c6f-aa72-78ead1367a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:43.033983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b2df5-f39e-4c6f-aa72-78ead1367a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:43.037698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44b2df5-f39e-4c6f-aa72-78ead1367a6f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:43.073150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1206/2427] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:42 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:43.077799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c794112-0ab4-4808-a700-4f53c2d9c5fd None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:43.094692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c794112-0ab4-4808-a700-4f53c2d9c5fd None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:43.206759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b872e-16b3-42b0-8c0b-2adc4eab5fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:43.208054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b872e-16b3-42b0-8c0b-2adc4eab5fed admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:43.208687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b872e-16b3-42b0-8c0b-2adc4eab5fed admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:43.209630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b872e-16b3-42b0-8c0b-2adc4eab5fed admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:43.211400 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b872e-16b3-42b0-8c0b-2adc4eab5fed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:43.215453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b872e-16b3-42b0-8c0b-2adc4eab5fed admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:43.271724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1222/2428] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:43 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:43.273381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b2df5-f39e-4c6f-aa72-78ead1367a6f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:43.292909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44b2df5-f39e-4c6f-aa72-78ead1367a6f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:43.308852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbdf3e-33d9-4c45-9dab-1115789b8639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:43.309580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbdf3e-33d9-4c45-9dab-1115789b8639 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:43.309921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbdf3e-33d9-4c45-9dab-1115789b8639 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:43.310273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddbdf3e-33d9-4c45-9dab-1115789b8639 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:43.311932 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbdf3e-33d9-4c45-9dab-1115789b8639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:43.319852 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddbdf3e-33d9-4c45-9dab-1115789b8639 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:43.339573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1207/2429] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:43.340616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b872e-16b3-42b0-8c0b-2adc4eab5fed admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:43.352859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b872e-16b3-42b0-8c0b-2adc4eab5fed admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:43.359236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff514f-3991-4681-acdc-b6847652c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:43.360284 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff514f-3991-4681-acdc-b6847652c42a admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:43.360737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff514f-3991-4681-acdc-b6847652c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:43.361297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff514f-3991-4681-acdc-b6847652c42a admin admin] PATH_INFO: `/v3/projects/e6fa4b9083c04b01b0399d0ca68d4333/users/bcc023d5bf6d42658b131ee7c1cb2b7d/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:43.383105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff514f-3991-4681-acdc-b6847652c42a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fa4b9083c04b01b0399d0ca68d4333, user_id=bcc023d5bf6d42658b131ee7c1cb2b7d, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:43.388339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff514f-3991-4681-acdc-b6847652c42a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:43.422631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1223/2430] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:43 2022] PUT /identity/v3/projects/e6fa4b9083c04b01b0399d0ca68d4333/users/bcc023d5bf6d42658b131ee7c1cb2b7d/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:43.426609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbdf3e-33d9-4c45-9dab-1115789b8639 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:43.437603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddbdf3e-33d9-4c45-9dab-1115789b8639 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:43.515970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cfce68-c878-4d9e-ac69-214a52934f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:43.516853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfce68-c878-4d9e-ac69-214a52934f95 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:43.517220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfce68-c878-4d9e-ac69-214a52934f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:43.517568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cfce68-c878-4d9e-ac69-214a52934f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:43.518491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfce68-c878-4d9e-ac69-214a52934f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:43.520210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cfce68-c878-4d9e-ac69-214a52934f95 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:43.533797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1208/2431] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:43 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:43.539584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff514f-3991-4681-acdc-b6847652c42a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:43.555674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff514f-3991-4681-acdc-b6847652c42a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:43.570587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57071-de10-4a7a-af1f-75d5c738bdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:43.571514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57071-de10-4a7a-af1f-75d5c738bdb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:43.572550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57071-de10-4a7a-af1f-75d5c738bdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:43.573330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a57071-de10-4a7a-af1f-75d5c738bdb3 admin admin] PATH_INFO: `/v3/projects/e6fa4b9083c04b01b0399d0ca68d4333/users/bcc023d5bf6d42658b131ee7c1cb2b7d/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:43.577472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57071-de10-4a7a-af1f-75d5c738bdb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6fa4b9083c04b01b0399d0ca68d4333, user_id=bcc023d5bf6d42658b131ee7c1cb2b7d, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:43.582485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a57071-de10-4a7a-af1f-75d5c738bdb3 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:43.599260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1224/2432] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:43 2022] PUT /identity/v3/projects/e6fa4b9083c04b01b0399d0ca68d4333/users/bcc023d5bf6d42658b131ee7c1cb2b7d/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:43.611364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a353d-0973-4da8-92e5-c752382bd5c7 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:43.611650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a353d-0973-4da8-92e5-c752382bd5c7 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:43.611934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7a353d-0973-4da8-92e5-c752382bd5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:43.652492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-5f7a353d-0973-4da8-92e5-c752382bd5c7 None None] MFA Rules not processed for user `bcc023d5bf6d42658b131ee7c1cb2b7d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:43.654121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5f7a353d-0973-4da8-92e5-c752382bd5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:43.666424 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:43.756870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1209/2433] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:43.764349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57071-de10-4a7a-af1f-75d5c738bdb3 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:43.766151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-17a57071-de10-4a7a-af1f-75d5c738bdb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:43.797112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:43.834558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a57071-de10-4a7a-af1f-75d5c738bdb3 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:43.838916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ff188-5c3d-43a6-86b4-46b844398992 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:43.839891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ff188-5c3d-43a6-86b4-46b844398992 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:43.840278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ff188-5c3d-43a6-86b4-46b844398992 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:43.840782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ff188-5c3d-43a6-86b4-46b844398992 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:43.854520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ff188-5c3d-43a6-86b4-46b844398992 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:43.856959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ff188-5c3d-43a6-86b4-46b844398992 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:43.868201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1225/2434] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:43 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:44.043369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a353d-0973-4da8-92e5-c752382bd5c7 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:44.123212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7a353d-0973-4da8-92e5-c752382bd5c7 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:44.127795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:44.128425 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:44.128735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:44.129009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] PATH_INFO: `/v3/users/298bf7e80253406b88d6afd040134e19` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:44.130178 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=298bf7e80253406b88d6afd040134e19)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:44.132137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:44.182592 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '298bf7e80253406b88d6afd040134e19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.196706 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '298bf7e80253406b88d6afd040134e19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.197333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '298bf7e80253406b88d6afd040134e19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.212012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '298bf7e80253406b88d6afd040134e19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.222746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '298bf7e80253406b88d6afd040134e19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.231925 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1210/2435] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:44 2022] DELETE /identity/v3/users/298bf7e80253406b88d6afd040134e19 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:44.236301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931f145-7cd4-42f0-8647-e453349f8148 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:44.236764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931f145-7cd4-42f0-8647-e453349f8148 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:44.236878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931f145-7cd4-42f0-8647-e453349f8148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:44.259582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c931f145-7cd4-42f0-8647-e453349f8148 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:44.260763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c931f145-7cd4-42f0-8647-e453349f8148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:44.326900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1226/2436] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:44.337005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:44.338480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:44.368397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:44.404426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868cf944-7f04-466d-8f25-7278c49a0a57 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:44.410410 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9f198-b504-4cc2-926f-f7ca22aaa6d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:44.411028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9f198-b504-4cc2-926f-f7ca22aaa6d9 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:44.411305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9f198-b504-4cc2-926f-f7ca22aaa6d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:44.411581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9f198-b504-4cc2-926f-f7ca22aaa6d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:44.429497 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9f198-b504-4cc2-926f-f7ca22aaa6d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:44.430980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9f198-b504-4cc2-926f-f7ca22aaa6d9 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:44.445186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1211/2437] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:44.835607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931f145-7cd4-42f0-8647-e453349f8148 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:44.837380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c931f145-7cd4-42f0-8647-e453349f8148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:44.855296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931f145-7cd4-42f0-8647-e453349f8148 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:44.860236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:44.861660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:44.861660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:44.861660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] PATH_INFO: `/v3/projects/b3c02579415a4c499709273e2f364072` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:44.862680 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c02579415a4c499709273e2f364072)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:44.864790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:44.918223 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c02579415a4c499709273e2f364072', 'request_id': 'req-c798e74f-ed47-480f-b9f0-6600c75c7d30'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.928014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c02579415a4c499709273e2f364072', 'request_id': 'req-c798e74f-ed47-480f-b9f0-6600c75c7d30'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.935472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c02579415a4c499709273e2f364072', 'request_id': 'req-c798e74f-ed47-480f-b9f0-6600c75c7d30'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.951143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] The token cache is being invalidate because project b3c02579415a4c499709273e2f364072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:44.951530 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.952603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:44.957162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1227/2438] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:44 2022] DELETE /identity/v3/projects/b3c02579415a4c499709273e2f364072 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:44.958423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9f198-b504-4cc2-926f-f7ca22aaa6d9 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:44.971167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9f198-b504-4cc2-926f-f7ca22aaa6d9 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:45.034285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:45.035105 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:45.035454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:45.035806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] PATH_INFO: `/v3/users/bcc023d5bf6d42658b131ee7c1cb2b7d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:45.037209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc023d5bf6d42658b131ee7c1cb2b7d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:45.039576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:45.095731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc023d5bf6d42658b131ee7c1cb2b7d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.103895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc023d5bf6d42658b131ee7c1cb2b7d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.104668 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc023d5bf6d42658b131ee7c1cb2b7d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.132155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc023d5bf6d42658b131ee7c1cb2b7d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.153253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-b908efef-c366-4c1b-8724-093d867c28be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc023d5bf6d42658b131ee7c1cb2b7d'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.161942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1212/2439] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:44 2022] DELETE /identity/v3/users/bcc023d5bf6d42658b131ee7c1cb2b7d => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:45.492899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:45.494429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:45.508315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c798e74f-ed47-480f-b9f0-6600c75c7d30 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:45.574977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:45.599058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:45.599727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:45.600084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:45.600448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] PATH_INFO: `/v3/projects/e6fa4b9083c04b01b0399d0ca68d4333` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:45.602031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6fa4b9083c04b01b0399d0ca68d4333)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:45.604086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:45.666512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6fa4b9083c04b01b0399d0ca68d4333', 'request_id': 'req-3368aec5-c23f-4590-925c-30bd87b3621f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.677957 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6fa4b9083c04b01b0399d0ca68d4333', 'request_id': 'req-3368aec5-c23f-4590-925c-30bd87b3621f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.687781 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6fa4b9083c04b01b0399d0ca68d4333', 'request_id': 'req-3368aec5-c23f-4590-925c-30bd87b3621f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.703202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] The token cache is being invalidate because project e6fa4b9083c04b01b0399d0ca68d4333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:45.703522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.704184 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3368aec5-c23f-4590-925c-30bd87b3621f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:45.705757 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1228/2440] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:45 2022] DELETE /identity/v3/projects/e6fa4b9083c04b01b0399d0ca68d4333 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:45.710600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77382faa-010b-435b-98ff-5a69cea7e97f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:45.711145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77382faa-010b-435b-98ff-5a69cea7e97f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:45.711427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77382faa-010b-435b-98ff-5a69cea7e97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:45.733261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-77382faa-010b-435b-98ff-5a69cea7e97f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:45.734539 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-77382faa-010b-435b-98ff-5a69cea7e97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:45.779088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:45.804194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1213/2441] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:45.809120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071d0b-a5a0-4054-a158-83aaa351defd None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:45.809420 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071d0b-a5a0-4054-a158-83aaa351defd None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:45.809705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b071d0b-a5a0-4054-a158-83aaa351defd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:45.830739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-4b071d0b-a5a0-4054-a158-83aaa351defd None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:45.832135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4b071d0b-a5a0-4054-a158-83aaa351defd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:45.846111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1229/2442] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:45.847024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77382faa-010b-435b-98ff-5a69cea7e97f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:45.860778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77382faa-010b-435b-98ff-5a69cea7e97f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:45.867598 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97858e36-7526-40ed-88cc-43f3c8d773aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:45.868659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97858e36-7526-40ed-88cc-43f3c8d773aa admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:45.869049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97858e36-7526-40ed-88cc-43f3c8d773aa admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:45.869453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97858e36-7526-40ed-88cc-43f3c8d773aa admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:45.870299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97858e36-7526-40ed-88cc-43f3c8d773aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:54:45.885218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97858e36-7526-40ed-88cc-43f3c8d773aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:45.892424 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97858e36-7526-40ed-88cc-43f3c8d773aa admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:45.921488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1214/2443] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:54:45.925118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071d0b-a5a0-4054-a158-83aaa351defd None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:45.935308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b071d0b-a5a0-4054-a158-83aaa351defd None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:45.940548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480929-e2eb-4e6d-bdd9-22930a9e60d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:45.941170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480929-e2eb-4e6d-bdd9-22930a9e60d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:45.941700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480929-e2eb-4e6d-bdd9-22930a9e60d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:45.942011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8480929-e2eb-4e6d-bdd9-22930a9e60d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:45.942753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8480929-e2eb-4e6d-bdd9-22930a9e60d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:45.944701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8480929-e2eb-4e6d-bdd9-22930a9e60d1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:45.978884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1230/2444] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:45 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:45.983725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97858e36-7526-40ed-88cc-43f3c8d773aa admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:46.009862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97858e36-7526-40ed-88cc-43f3c8d773aa admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:46.117552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2abe0-43de-4e0a-993e-1e2a1c80464f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:46.119040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2abe0-43de-4e0a-993e-1e2a1c80464f admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:46.119560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2abe0-43de-4e0a-993e-1e2a1c80464f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:46.120075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2abe0-43de-4e0a-993e-1e2a1c80464f admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:46.121898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2abe0-43de-4e0a-993e-1e2a1c80464f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:46.125000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2abe0-43de-4e0a-993e-1e2a1c80464f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:46.163350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1215/2445] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:45 2022] POST /identity/v3/users => generated 287 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:46.167815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480929-e2eb-4e6d-bdd9-22930a9e60d1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:46.180433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8480929-e2eb-4e6d-bdd9-22930a9e60d1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:46.186372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d69ec-66d8-4be3-b933-819f95d81ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:46.187114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d69ec-66d8-4be3-b933-819f95d81ffb admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:46.187477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d69ec-66d8-4be3-b933-819f95d81ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:46.187593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d69ec-66d8-4be3-b933-819f95d81ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:46.188294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d69ec-66d8-4be3-b933-819f95d81ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:46.190116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d69ec-66d8-4be3-b933-819f95d81ffb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:46.201560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1231/2446] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:46.205667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2abe0-43de-4e0a-993e-1e2a1c80464f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:46.217353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2abe0-43de-4e0a-993e-1e2a1c80464f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:46.221768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d69ec-66d8-4be3-b933-819f95d81ffb admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:46.224102 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-998d69ec-66d8-4be3-b933-819f95d81ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:46.231682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401412a-1518-476d-9692-1f08d128f6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:46.232316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401412a-1518-476d-9692-1f08d128f6b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:46.233798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401412a-1518-476d-9692-1f08d128f6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:46.234534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401412a-1518-476d-9692-1f08d128f6b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:46.235600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401412a-1518-476d-9692-1f08d128f6b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:46.237969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401412a-1518-476d-9692-1f08d128f6b7 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:46.244328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d69ec-66d8-4be3-b933-819f95d81ffb admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:46.249580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:46.250225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:46.250520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:46.250784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] PATH_INFO: `/v3/users/37cbddfb1f714d2eb8c0c7978f7cc532` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:46.251991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=37cbddfb1f714d2eb8c0c7978f7cc532)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:46.253922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:46.255310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1216/2447] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:46 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:46.259391 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401412a-1518-476d-9692-1f08d128f6b7 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:46.270171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401412a-1518-476d-9692-1f08d128f6b7 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:46.275612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55feb18f-8bdf-4310-b30d-7cc978955921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:46.277033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb18f-8bdf-4310-b30d-7cc978955921 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:46.277322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb18f-8bdf-4310-b30d-7cc978955921 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:46.277636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55feb18f-8bdf-4310-b30d-7cc978955921 admin admin] PATH_INFO: `/v3/projects/6c3d9086cd9843ab98b6ed12108844a2/users/f6ae75d024514b8e8dbb42c16f9b431f/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:46.310468 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55feb18f-8bdf-4310-b30d-7cc978955921 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c3d9086cd9843ab98b6ed12108844a2, user_id=f6ae75d024514b8e8dbb42c16f9b431f, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:46.313236 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55feb18f-8bdf-4310-b30d-7cc978955921 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:46.332406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37cbddfb1f714d2eb8c0c7978f7cc532'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:46.341741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1217/2448] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:46 2022] PUT /identity/v3/projects/6c3d9086cd9843ab98b6ed12108844a2/users/f6ae75d024514b8e8dbb42c16f9b431f/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:46.344009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37cbddfb1f714d2eb8c0c7978f7cc532'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:46.351809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37cbddfb1f714d2eb8c0c7978f7cc532'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:46.352711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48678bf-8b07-48a7-9a68-c022fad3aa22 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:46.353014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48678bf-8b07-48a7-9a68-c022fad3aa22 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:46.353287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48678bf-8b07-48a7-9a68-c022fad3aa22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:46.363287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37cbddfb1f714d2eb8c0c7978f7cc532'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:46.380871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c215b948-110a-4092-9db2-a82383a017cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37cbddfb1f714d2eb8c0c7978f7cc532'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:46.388176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1232/2449] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:46 2022] DELETE /identity/v3/users/37cbddfb1f714d2eb8c0c7978f7cc532 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:46.395910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b48678bf-8b07-48a7-9a68-c022fad3aa22 None None] MFA Rules not processed for user `f6ae75d024514b8e8dbb42c16f9b431f`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:46.397235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b48678bf-8b07-48a7-9a68-c022fad3aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:46.403710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fb0b7-4f32-43e4-afc3-b51a275eaba9 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:46.404071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fb0b7-4f32-43e4-afc3-b51a275eaba9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:46.404356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390fb0b7-4f32-43e4-afc3-b51a275eaba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:46.431632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-390fb0b7-4f32-43e4-afc3-b51a275eaba9 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:46.433841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-390fb0b7-4f32-43e4-afc3-b51a275eaba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:46.439631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:46.515394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1233/2450] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:46.522495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fb0b7-4f32-43e4-afc3-b51a275eaba9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:46.524421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-390fb0b7-4f32-43e4-afc3-b51a275eaba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:46.558316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1218/2451] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:46.559374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48678bf-8b07-48a7-9a68-c022fad3aa22 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:46.560800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b48678bf-8b07-48a7-9a68-c022fad3aa22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:46.594784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:46.660545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390fb0b7-4f32-43e4-afc3-b51a275eaba9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:46.663333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48678bf-8b07-48a7-9a68-c022fad3aa22 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:46.665612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc77922-9677-4424-86c2-2ef3ba812059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:46.666560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc77922-9677-4424-86c2-2ef3ba812059 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:46.667116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc77922-9677-4424-86c2-2ef3ba812059 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:46.667440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc77922-9677-4424-86c2-2ef3ba812059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:46.668341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def60f9-67bd-4c83-95aa-9cc992540320 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:46.669029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def60f9-67bd-4c83-95aa-9cc992540320 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:46.669314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def60f9-67bd-4c83-95aa-9cc992540320 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:46.669620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7def60f9-67bd-4c83-95aa-9cc992540320 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:46.679044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def60f9-67bd-4c83-95aa-9cc992540320 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:46.680500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7def60f9-67bd-4c83-95aa-9cc992540320 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:46.681101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc77922-9677-4424-86c2-2ef3ba812059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:46.682894 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc77922-9677-4424-86c2-2ef3ba812059 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:46.695614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1234/2452] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:46.705390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1219/2453] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:47.095406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc77922-9677-4424-86c2-2ef3ba812059 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:47.097217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-bbc77922-9677-4424-86c2-2ef3ba812059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:47.118492 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc77922-9677-4424-86c2-2ef3ba812059 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:47.136728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:47.137347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:47.137733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:47.138087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] PATH_INFO: `/v3/projects/ddc2cacebb7a43eaa599414527fdebe4` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:47.140148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddc2cacebb7a43eaa599414527fdebe4)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:47.142228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:47.233091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddc2cacebb7a43eaa599414527fdebe4', 'request_id': 'req-c47a04b3-0cc0-4046-affb-8ca400e81e27'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.246243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddc2cacebb7a43eaa599414527fdebe4', 'request_id': 'req-c47a04b3-0cc0-4046-affb-8ca400e81e27'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.253705 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddc2cacebb7a43eaa599414527fdebe4', 'request_id': 'req-c47a04b3-0cc0-4046-affb-8ca400e81e27'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.267165 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] The token cache is being invalidate because project ddc2cacebb7a43eaa599414527fdebe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:47.267462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.268241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.269913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1235/2454] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:47 2022] DELETE /identity/v3/projects/ddc2cacebb7a43eaa599414527fdebe4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:47.274148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def60f9-67bd-4c83-95aa-9cc992540320 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:47.290135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7def60f9-67bd-4c83-95aa-9cc992540320 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:47.355345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:47.356459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:47.356801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:47.357103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] PATH_INFO: `/v3/users/ef507bb8411d4150a12c5b1d531a3366` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:47.358427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef507bb8411d4150a12c5b1d531a3366)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:47.360621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:47.430432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef507bb8411d4150a12c5b1d531a3366'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.443046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef507bb8411d4150a12c5b1d531a3366'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.443736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef507bb8411d4150a12c5b1d531a3366'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.462788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef507bb8411d4150a12c5b1d531a3366'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.472108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6dd10bca-0344-499f-a78d-d57f231b8cec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef507bb8411d4150a12c5b1d531a3366'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:47.479771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1220/2455] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:47 2022] DELETE /identity/v3/users/ef507bb8411d4150a12c5b1d531a3366 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:47.887999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:47.894024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:47.919151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47a04b3-0cc0-4046-affb-8ca400e81e27 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:47.967130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:47.992767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:47.993429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:47.993727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:47.994006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] PATH_INFO: `/v3/projects/69def2a3ee0440f4924e297c37bf66c1` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:47.995750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=69def2a3ee0440f4924e297c37bf66c1)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:48.005192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:48.055160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69def2a3ee0440f4924e297c37bf66c1', 'request_id': 'req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:48.063296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69def2a3ee0440f4924e297c37bf66c1', 'request_id': 'req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:48.069024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69def2a3ee0440f4924e297c37bf66c1', 'request_id': 'req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:48.080630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] The token cache is being invalidate because project 69def2a3ee0440f4924e297c37bf66c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:48.080921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:48.081561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-70ccbcbc-2113-46f7-8e2d-7e8a34141c0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:48.083061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1236/2456] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:47 2022] DELETE /identity/v3/projects/69def2a3ee0440f4924e297c37bf66c1 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:48.095285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302aa03-9398-4e79-8ac0-c8075ea6f79f None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:48.095687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302aa03-9398-4e79-8ac0-c8075ea6f79f None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:48.096033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2302aa03-9398-4e79-8ac0-c8075ea6f79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:48.120761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-2302aa03-9398-4e79-8ac0-c8075ea6f79f None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:48.122400 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2302aa03-9398-4e79-8ac0-c8075ea6f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:48.160509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:48.193723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1221/2457] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:48.201735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38b0ae-5933-4b57-922f-a9575921ca5e None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:48.202021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38b0ae-5933-4b57-922f-a9575921ca5e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:48.202303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b38b0ae-5933-4b57-922f-a9575921ca5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:48.239224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0b38b0ae-5933-4b57-922f-a9575921ca5e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:48.240997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0b38b0ae-5933-4b57-922f-a9575921ca5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:48.254880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1237/2458] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:48.256061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302aa03-9398-4e79-8ac0-c8075ea6f79f None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:48.267381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2302aa03-9398-4e79-8ac0-c8075ea6f79f None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:48.278599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0094-c958-4a01-8a43-0b7c7f0ef8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:48.280161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0094-c958-4a01-8a43-0b7c7f0ef8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:48.280664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0094-c958-4a01-8a43-0b7c7f0ef8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:48.281164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e0094-c958-4a01-8a43-0b7c7f0ef8b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:48.282081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0094-c958-4a01-8a43-0b7c7f0ef8b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:54:48.282610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0094-c958-4a01-8a43-0b7c7f0ef8b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:48.284990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e0094-c958-4a01-8a43-0b7c7f0ef8b9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:48.307270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1222/2459] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:54:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:54:48.308417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38b0ae-5933-4b57-922f-a9575921ca5e None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:48.319031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b38b0ae-5933-4b57-922f-a9575921ca5e None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:48.326321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1daab6-176f-4b51-8ebb-5b9e34d29b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:48.326971 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1daab6-176f-4b51-8ebb-5b9e34d29b7d admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:48.327255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1daab6-176f-4b51-8ebb-5b9e34d29b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:48.327685 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1daab6-176f-4b51-8ebb-5b9e34d29b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:48.328179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1daab6-176f-4b51-8ebb-5b9e34d29b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:48.330132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1daab6-176f-4b51-8ebb-5b9e34d29b7d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:48.368887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1238/2460] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:48 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:48.373471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0094-c958-4a01-8a43-0b7c7f0ef8b9 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:48.383880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e0094-c958-4a01-8a43-0b7c7f0ef8b9 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:48.465113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eadd97-5d8e-488d-98ad-73b361e8103e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:48.465734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eadd97-5d8e-488d-98ad-73b361e8103e admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:48.466009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eadd97-5d8e-488d-98ad-73b361e8103e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:48.466278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eadd97-5d8e-488d-98ad-73b361e8103e admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:48.467138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eadd97-5d8e-488d-98ad-73b361e8103e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:48.472192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eadd97-5d8e-488d-98ad-73b361e8103e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:48.500678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1223/2461] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:48 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:48.502422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1daab6-176f-4b51-8ebb-5b9e34d29b7d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:48.523065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1daab6-176f-4b51-8ebb-5b9e34d29b7d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:48.524388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3e648-232e-4fae-9cb9-71ecc5dc46c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:48.525136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3e648-232e-4fae-9cb9-71ecc5dc46c7 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:48.525292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3e648-232e-4fae-9cb9-71ecc5dc46c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:48.525568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e3e648-232e-4fae-9cb9-71ecc5dc46c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:48.526248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3e648-232e-4fae-9cb9-71ecc5dc46c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:48.528624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e3e648-232e-4fae-9cb9-71ecc5dc46c7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:48.551064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1239/2462] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:48.555143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eadd97-5d8e-488d-98ad-73b361e8103e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:48.572773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eadd97-5d8e-488d-98ad-73b361e8103e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:48.586272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c1762-0901-4d84-9ca0-64eab45a4140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:48.586910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1762-0901-4d84-9ca0-64eab45a4140 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:48.587348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1762-0901-4d84-9ca0-64eab45a4140 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:48.587679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c1762-0901-4d84-9ca0-64eab45a4140 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:48.588394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c1762-0901-4d84-9ca0-64eab45a4140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:48.591013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c1762-0901-4d84-9ca0-64eab45a4140 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:48.605827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1224/2463] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:48 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:48.608305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3e648-232e-4fae-9cb9-71ecc5dc46c7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:48.620815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e3e648-232e-4fae-9cb9-71ecc5dc46c7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:48.626899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ac431-b97b-447a-b0ee-3ac417e1a9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:48.627577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac431-b97b-447a-b0ee-3ac417e1a9b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:48.627862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac431-b97b-447a-b0ee-3ac417e1a9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:48.628148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ac431-b97b-447a-b0ee-3ac417e1a9b0 admin admin] PATH_INFO: `/v3/projects/8454edcf4def4efe807741f4b9bae21d/users/f998ff3027474caaa723c7d906b140e7/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:48.650257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ac431-b97b-447a-b0ee-3ac417e1a9b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8454edcf4def4efe807741f4b9bae21d, user_id=f998ff3027474caaa723c7d906b140e7, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:48.652963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ac431-b97b-447a-b0ee-3ac417e1a9b0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:48.693446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1240/2464] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:48 2022] PUT /identity/v3/projects/8454edcf4def4efe807741f4b9bae21d/users/f998ff3027474caaa723c7d906b140e7/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:48.706162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfb23c-57c8-4ff6-b49f-d060270a8025 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:48.706939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfb23c-57c8-4ff6-b49f-d060270a8025 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:48.707631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcfb23c-57c8-4ff6-b49f-d060270a8025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:48.750364 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-4bcfb23c-57c8-4ff6-b49f-d060270a8025 None None] MFA Rules not processed for user `f998ff3027474caaa723c7d906b140e7`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:48.754461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-4bcfb23c-57c8-4ff6-b49f-d060270a8025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:48.874965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1225/2465] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:48 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:48.876199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ac431-b97b-447a-b0ee-3ac417e1a9b0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.029257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ac431-b97b-447a-b0ee-3ac417e1a9b0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.034571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3443761-817b-401c-a026-015100c6c023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.035205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3443761-817b-401c-a026-015100c6c023 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.035491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3443761-817b-401c-a026-015100c6c023 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.035771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3443761-817b-401c-a026-015100c6c023 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.036438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3443761-817b-401c-a026-015100c6c023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.043019 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3443761-817b-401c-a026-015100c6c023 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.058534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:49.083814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1241/2466] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:48 2022] POST /identity/v3/projects => generated 387 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:49.088422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfb23c-57c8-4ff6-b49f-d060270a8025 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.099831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcfb23c-57c8-4ff6-b49f-d060270a8025 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.147445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:49.174657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af638e43-e49c-4249-b889-d87a7c0f2054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.175472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af638e43-e49c-4249-b889-d87a7c0f2054 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.175875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af638e43-e49c-4249-b889-d87a7c0f2054 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.176151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af638e43-e49c-4249-b889-d87a7c0f2054 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.176779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af638e43-e49c-4249-b889-d87a7c0f2054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.178756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af638e43-e49c-4249-b889-d87a7c0f2054 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.206482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1226/2467] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:49 2022] POST /identity/v3/users => generated 294 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:49.208639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3443761-817b-401c-a026-015100c6c023 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.219389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3443761-817b-401c-a026-015100c6c023 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.224015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cb174-fd52-43cc-934a-a4e9da8d8b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.224603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cb174-fd52-43cc-934a-a4e9da8d8b53 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.224880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cb174-fd52-43cc-934a-a4e9da8d8b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.225150 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cb174-fd52-43cc-934a-a4e9da8d8b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.225812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cb174-fd52-43cc-934a-a4e9da8d8b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.227394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cb174-fd52-43cc-934a-a4e9da8d8b53 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.237338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1242/2468] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:49.241043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af638e43-e49c-4249-b889-d87a7c0f2054 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.251308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af638e43-e49c-4249-b889-d87a7c0f2054 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.255859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c86602-d6d1-486f-8894-0569016b3d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.256451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c86602-d6d1-486f-8894-0569016b3d1c admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.256729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c86602-d6d1-486f-8894-0569016b3d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.257001 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c86602-d6d1-486f-8894-0569016b3d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.257667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c86602-d6d1-486f-8894-0569016b3d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.259266 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c86602-d6d1-486f-8894-0569016b3d1c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.270520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1227/2469] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:49.274397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cb174-fd52-43cc-934a-a4e9da8d8b53 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.284305 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cb174-fd52-43cc-934a-a4e9da8d8b53 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.288931 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51da54-11d4-4f2e-a967-6f8d4917d3a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.289614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51da54-11d4-4f2e-a967-6f8d4917d3a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.289898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51da54-11d4-4f2e-a967-6f8d4917d3a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.290176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51da54-11d4-4f2e-a967-6f8d4917d3a4 admin admin] PATH_INFO: `/v3/projects/403d53d448ab449d9b7690361c1f39e5/users/88dae0f44ccb482aa0bf100995805124/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.305367 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51da54-11d4-4f2e-a967-6f8d4917d3a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=403d53d448ab449d9b7690361c1f39e5, user_id=88dae0f44ccb482aa0bf100995805124, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.312391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee51da54-11d4-4f2e-a967-6f8d4917d3a4 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.328335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1243/2470] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:49 2022] PUT /identity/v3/projects/403d53d448ab449d9b7690361c1f39e5/users/88dae0f44ccb482aa0bf100995805124/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:49.338758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d6ef-ccad-459f-ab5b-ad9fd7c13266 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.339229 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d6ef-ccad-459f-ab5b-ad9fd7c13266 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.339327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a3d6ef-ccad-459f-ab5b-ad9fd7c13266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.367108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-94a3d6ef-ccad-459f-ab5b-ad9fd7c13266 None None] MFA Rules not processed for user `88dae0f44ccb482aa0bf100995805124`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:49.368294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-94a3d6ef-ccad-459f-ab5b-ad9fd7c13266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:49.432078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1228/2471] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:49.437020 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51da54-11d4-4f2e-a967-6f8d4917d3a4 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.497034 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee51da54-11d4-4f2e-a967-6f8d4917d3a4 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.501542 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cdd91-2dab-4887-b2c9-a30e85dfb651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.502132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cdd91-2dab-4887-b2c9-a30e85dfb651 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.502409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cdd91-2dab-4887-b2c9-a30e85dfb651 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.502679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cdd91-2dab-4887-b2c9-a30e85dfb651 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.503296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cdd91-2dab-4887-b2c9-a30e85dfb651 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.505180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cdd91-2dab-4887-b2c9-a30e85dfb651 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.531270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1244/2472] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:49 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:49.535481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d6ef-ccad-459f-ab5b-ad9fd7c13266 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.546131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a3d6ef-ccad-459f-ab5b-ad9fd7c13266 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.603034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43450e-288d-4551-85c8-887d6f2c394e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.603642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43450e-288d-4551-85c8-887d6f2c394e admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.603919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43450e-288d-4551-85c8-887d6f2c394e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.604190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43450e-288d-4551-85c8-887d6f2c394e admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.605949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43450e-288d-4551-85c8-887d6f2c394e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.611345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d43450e-288d-4551-85c8-887d6f2c394e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.639667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1229/2473] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:49 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:49.643741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cdd91-2dab-4887-b2c9-a30e85dfb651 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.655735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cdd91-2dab-4887-b2c9-a30e85dfb651 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.660514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0cf2-4da0-4f5b-a9e4-d7523319b5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.661110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0cf2-4da0-4f5b-a9e4-d7523319b5ef admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.661388 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0cf2-4da0-4f5b-a9e4-d7523319b5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.661712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e0cf2-4da0-4f5b-a9e4-d7523319b5ef admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.662353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0cf2-4da0-4f5b-a9e4-d7523319b5ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.663934 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109e0cf2-4da0-4f5b-a9e4-d7523319b5ef admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.675048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1245/2474] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:49.679236 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43450e-288d-4551-85c8-887d6f2c394e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.690221 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d43450e-288d-4551-85c8-887d6f2c394e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.694869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468618f8-2162-427d-97d6-28f25a69df99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.695503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468618f8-2162-427d-97d6-28f25a69df99 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.695778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468618f8-2162-427d-97d6-28f25a69df99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.696052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468618f8-2162-427d-97d6-28f25a69df99 admin admin] PATH_INFO: `/v3/projects/c2298ae780dc48ad8f2a2ff9561f07ad/users/ec90438351b6459f9bbbf3aadb1e0110/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.710590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468618f8-2162-427d-97d6-28f25a69df99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2298ae780dc48ad8f2a2ff9561f07ad, user_id=ec90438351b6459f9bbbf3aadb1e0110, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.713529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468618f8-2162-427d-97d6-28f25a69df99 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.725978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1230/2475] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:49 2022] PUT /identity/v3/projects/c2298ae780dc48ad8f2a2ff9561f07ad/users/ec90438351b6459f9bbbf3aadb1e0110/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:49.730408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0cf2-4da0-4f5b-a9e4-d7523319b5ef admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.740348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e0cf2-4da0-4f5b-a9e4-d7523319b5ef admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.794599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db78ebdb-c613-440e-983d-864aad0e58b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.795200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ebdb-c613-440e-983d-864aad0e58b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.795477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ebdb-c613-440e-983d-864aad0e58b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.795743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db78ebdb-c613-440e-983d-864aad0e58b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.796371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78ebdb-c613-440e-983d-864aad0e58b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.797977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db78ebdb-c613-440e-983d-864aad0e58b8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.807334 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1246/2476] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:49 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:49.811994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468618f8-2162-427d-97d6-28f25a69df99 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.822065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468618f8-2162-427d-97d6-28f25a69df99 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:49.826564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01603d-a43c-4f50-babb-1fa6430809f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:49.827209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01603d-a43c-4f50-babb-1fa6430809f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.827482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01603d-a43c-4f50-babb-1fa6430809f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.827751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee01603d-a43c-4f50-babb-1fa6430809f0 admin admin] PATH_INFO: `/v3/projects/c2298ae780dc48ad8f2a2ff9561f07ad/users/ec90438351b6459f9bbbf3aadb1e0110/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.829658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01603d-a43c-4f50-babb-1fa6430809f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2298ae780dc48ad8f2a2ff9561f07ad, user_id=ec90438351b6459f9bbbf3aadb1e0110, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:49.832269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee01603d-a43c-4f50-babb-1fa6430809f0 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:49.835268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:49.844374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1231/2477] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:49 2022] PUT /identity/v3/projects/c2298ae780dc48ad8f2a2ff9561f07ad/users/ec90438351b6459f9bbbf3aadb1e0110/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:49.855730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f96d-f3c2-49ec-bd95-2d8f146b6493 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:49.856013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f96d-f3c2-49ec-bd95-2d8f146b6493 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:49.856295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6f96d-f3c2-49ec-bd95-2d8f146b6493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:49.884092 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f0d6f96d-f3c2-49ec-bd95-2d8f146b6493 None None] MFA Rules not processed for user `ec90438351b6459f9bbbf3aadb1e0110`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:49.885297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f0d6f96d-f3c2-49ec-bd95-2d8f146b6493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:49.897467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:49.954901 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1247/2478] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:49.966608 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01603d-a43c-4f50-babb-1fa6430809f0 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:49.969215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ee01603d-a43c-4f50-babb-1fa6430809f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:50.024853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee01603d-a43c-4f50-babb-1fa6430809f0 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:50.029096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f9e9db-eaf8-4107-a9ac-df222bfd0ab9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:50.029730 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e9db-eaf8-4107-a9ac-df222bfd0ab9 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:50.030005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e9db-eaf8-4107-a9ac-df222bfd0ab9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:50.030272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f9e9db-eaf8-4107-a9ac-df222bfd0ab9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:50.039283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e9db-eaf8-4107-a9ac-df222bfd0ab9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:50.040722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f9e9db-eaf8-4107-a9ac-df222bfd0ab9 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:50.051151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1232/2479] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:50.051511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f96d-f3c2-49ec-bd95-2d8f146b6493 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:50.052946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f0d6f96d-f3c2-49ec-bd95-2d8f146b6493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:50.119655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6f96d-f3c2-49ec-bd95-2d8f146b6493 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:50.124191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:50.124819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:50.125094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:50.125365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] PATH_INFO: `/v3/users/f6ae75d024514b8e8dbb42c16f9b431f` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:50.126513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6ae75d024514b8e8dbb42c16f9b431f)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:50.128457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:50.183978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6ae75d024514b8e8dbb42c16f9b431f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:50.194411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6ae75d024514b8e8dbb42c16f9b431f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:50.195412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6ae75d024514b8e8dbb42c16f9b431f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:50.204071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6ae75d024514b8e8dbb42c16f9b431f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:50.217861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6ae75d024514b8e8dbb42c16f9b431f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:50.226159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1248/2480] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:50 2022] DELETE /identity/v3/users/f6ae75d024514b8e8dbb42c16f9b431f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:50.231193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa1808-57bd-400a-90db-05f3b67ad2a2 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:50.231481 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa1808-57bd-400a-90db-05f3b67ad2a2 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:50.231753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa1808-57bd-400a-90db-05f3b67ad2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:50.255061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-67aa1808-57bd-400a-90db-05f3b67ad2a2 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:50.256261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-67aa1808-57bd-400a-90db-05f3b67ad2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:50.382520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1233/2481] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:50.394056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:50.395889 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:50.460059 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:50.506149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e76d83-b7ef-42ac-9517-59bf928c7aa2 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:50.511074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a97b0-8e63-4f13-bd57-6191f783cdd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:50.512114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a97b0-8e63-4f13-bd57-6191f783cdd5 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:50.512630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a97b0-8e63-4f13-bd57-6191f783cdd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:50.513198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a97b0-8e63-4f13-bd57-6191f783cdd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:50.524863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a97b0-8e63-4f13-bd57-6191f783cdd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:50.526720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a97b0-8e63-4f13-bd57-6191f783cdd5 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:50.539271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1249/2482] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:50.722804 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa1808-57bd-400a-90db-05f3b67ad2a2 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:50.725050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-67aa1808-57bd-400a-90db-05f3b67ad2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:50.791083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa1808-57bd-400a-90db-05f3b67ad2a2 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:50.796217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47df233b-caaf-48b6-b179-dc9b555eb822 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:50.796959 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df233b-caaf-48b6-b179-dc9b555eb822 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:50.797353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df233b-caaf-48b6-b179-dc9b555eb822 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:50.797851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47df233b-caaf-48b6-b179-dc9b555eb822 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:50.799832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-47df233b-caaf-48b6-b179-dc9b555eb822 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:50.890014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a97b0-8e63-4f13-bd57-6191f783cdd5 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:50.892082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-980a97b0-8e63-4f13-bd57-6191f783cdd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:50.897261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:50.902638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df233b-caaf-48b6-b179-dc9b555eb822 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:50.904314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47df233b-caaf-48b6-b179-dc9b555eb822 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:50.913360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a97b0-8e63-4f13-bd57-6191f783cdd5 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:50.918134 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1234/2483] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:50.918849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:50.919874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:50.920138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:50.920587 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] PATH_INFO: `/v3/projects/6c3d9086cd9843ab98b6ed12108844a2` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:50.921947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c3d9086cd9843ab98b6ed12108844a2)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:50.924061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:50.973262 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c3d9086cd9843ab98b6ed12108844a2', 'request_id': 'req-d55bc4aa-10ee-4646-8ea0-2e150a07b960'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:50.980923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c3d9086cd9843ab98b6ed12108844a2', 'request_id': 'req-d55bc4aa-10ee-4646-8ea0-2e150a07b960'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:50.987096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c3d9086cd9843ab98b6ed12108844a2', 'request_id': 'req-d55bc4aa-10ee-4646-8ea0-2e150a07b960'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:51.001563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] The token cache is being invalidate because project 6c3d9086cd9843ab98b6ed12108844a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:51.001861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:51.002518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d55bc4aa-10ee-4646-8ea0-2e150a07b960 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:51.004074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1250/2484] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:50 2022] DELETE /identity/v3/projects/6c3d9086cd9843ab98b6ed12108844a2 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:51.008993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044f99-15aa-4e0e-9666-46a80b3a1717 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.009287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044f99-15aa-4e0e-9666-46a80b3a1717 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.009600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9044f99-15aa-4e0e-9666-46a80b3a1717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.029620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e9044f99-15aa-4e0e-9666-46a80b3a1717 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:51.030820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e9044f99-15aa-4e0e-9666-46a80b3a1717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:51.093807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1235/2485] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:51.161386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904efbc-75a1-4ec6-80e6-75c03ea6a54c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.162044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904efbc-75a1-4ec6-80e6-75c03ea6a54c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.162044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904efbc-75a1-4ec6-80e6-75c03ea6a54c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.186304 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e904efbc-75a1-4ec6-80e6-75c03ea6a54c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:51.187512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e904efbc-75a1-4ec6-80e6-75c03ea6a54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:51.200374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9044f99-15aa-4e0e-9666-46a80b3a1717 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.200903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1251/2486] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:51.211756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9044f99-15aa-4e0e-9666-46a80b3a1717 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.217100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746ef6d-5371-49ed-9a35-81639023c76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.217677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ef6d-5371-49ed-9a35-81639023c76b admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.217960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ef6d-5371-49ed-9a35-81639023c76b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.218493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c746ef6d-5371-49ed-9a35-81639023c76b admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.219026 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746ef6d-5371-49ed-9a35-81639023c76b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:54:51.219371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746ef6d-5371-49ed-9a35-81639023c76b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.220942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c746ef6d-5371-49ed-9a35-81639023c76b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.239025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1236/2487] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:54:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:54:51.240338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904efbc-75a1-4ec6-80e6-75c03ea6a54c None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.254943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904efbc-75a1-4ec6-80e6-75c03ea6a54c None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.259885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c26675-b0b4-4627-ba30-7b7ffd32eae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.260647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26675-b0b4-4627-ba30-7b7ffd32eae9 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.260995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26675-b0b4-4627-ba30-7b7ffd32eae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.261338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c26675-b0b4-4627-ba30-7b7ffd32eae9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.262069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c26675-b0b4-4627-ba30-7b7ffd32eae9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.264069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c26675-b0b4-4627-ba30-7b7ffd32eae9 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.297477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1252/2488] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:51 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:51.301275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746ef6d-5371-49ed-9a35-81639023c76b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.313078 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c746ef6d-5371-49ed-9a35-81639023c76b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.370797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132e248-d085-4c85-9f2f-68ed38523d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.371415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132e248-d085-4c85-9f2f-68ed38523d6c admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.371697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132e248-d085-4c85-9f2f-68ed38523d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.372098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1132e248-d085-4c85-9f2f-68ed38523d6c admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.372782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132e248-d085-4c85-9f2f-68ed38523d6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.374709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1132e248-d085-4c85-9f2f-68ed38523d6c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.399612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1237/2489] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:51 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:51.400764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c26675-b0b4-4627-ba30-7b7ffd32eae9 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.413761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c26675-b0b4-4627-ba30-7b7ffd32eae9 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.420983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dec181-7210-4caa-947e-0fe7be77a492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.421629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dec181-7210-4caa-947e-0fe7be77a492 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.421912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dec181-7210-4caa-947e-0fe7be77a492 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.422191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dec181-7210-4caa-947e-0fe7be77a492 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.422961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dec181-7210-4caa-947e-0fe7be77a492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.424573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dec181-7210-4caa-947e-0fe7be77a492 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.440707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1253/2490] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:51.444738 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132e248-d085-4c85-9f2f-68ed38523d6c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.455188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1132e248-d085-4c85-9f2f-68ed38523d6c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.459807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e1b58-5e48-4aae-993f-e349a8021eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.460408 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e1b58-5e48-4aae-993f-e349a8021eec admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.460683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e1b58-5e48-4aae-993f-e349a8021eec admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.461208 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e1b58-5e48-4aae-993f-e349a8021eec admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.461878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e1b58-5e48-4aae-993f-e349a8021eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.463484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e1b58-5e48-4aae-993f-e349a8021eec admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.475547 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1238/2491] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:51.480380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dec181-7210-4caa-947e-0fe7be77a492 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.503898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dec181-7210-4caa-947e-0fe7be77a492 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.509779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355e237-5285-4e8a-be45-78a6fe10702b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.510508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355e237-5285-4e8a-be45-78a6fe10702b admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.510770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355e237-5285-4e8a-be45-78a6fe10702b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.511048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355e237-5285-4e8a-be45-78a6fe10702b admin admin] PATH_INFO: `/v3/projects/b403968f1ae44fc6977dde907809925d/users/ebee68a2f0834b69967ac7831593dcb3/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.531209 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355e237-5285-4e8a-be45-78a6fe10702b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b403968f1ae44fc6977dde907809925d, user_id=ebee68a2f0834b69967ac7831593dcb3, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.534131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e355e237-5285-4e8a-be45-78a6fe10702b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.553234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1254/2492] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:51 2022] PUT /identity/v3/projects/b403968f1ae44fc6977dde907809925d/users/ebee68a2f0834b69967ac7831593dcb3/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:51.563509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1f81-b343-4948-bfb0-877d9719808d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.563812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1f81-b343-4948-bfb0-877d9719808d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.564087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda1f81-b343-4948-bfb0-877d9719808d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.599395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0dda1f81-b343-4948-bfb0-877d9719808d None None] MFA Rules not processed for user `ebee68a2f0834b69967ac7831593dcb3`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:51.600644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0dda1f81-b343-4948-bfb0-877d9719808d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:51.655198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:51.673361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1239/2493] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:51.677848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355e237-5285-4e8a-be45-78a6fe10702b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.728982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:51.742461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355e237-5285-4e8a-be45-78a6fe10702b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.747988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda428d-539d-4d45-b1ef-6449872945a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.748755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda428d-539d-4d45-b1ef-6449872945a0 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.748874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda428d-539d-4d45-b1ef-6449872945a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.749136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eda428d-539d-4d45-b1ef-6449872945a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.749915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda428d-539d-4d45-b1ef-6449872945a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.751876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eda428d-539d-4d45-b1ef-6449872945a0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.778980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1255/2494] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:51 2022] POST /identity/v3/projects => generated 385 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:51.798634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda1f81-b343-4948-bfb0-877d9719808d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.811693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda1f81-b343-4948-bfb0-877d9719808d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.893214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd831c-beec-43f5-87b9-fcdf2656e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.893862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd831c-beec-43f5-87b9-fcdf2656e87b admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.894169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd831c-beec-43f5-87b9-fcdf2656e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.894443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fd831c-beec-43f5-87b9-fcdf2656e87b admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.895075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd831c-beec-43f5-87b9-fcdf2656e87b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.897002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fd831c-beec-43f5-87b9-fcdf2656e87b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.927376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1240/2495] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:51 2022] POST /identity/v3/users => generated 293 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:51.928910 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda428d-539d-4d45-b1ef-6449872945a0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.940507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eda428d-539d-4d45-b1ef-6449872945a0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.945635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2055b3-e3e4-4d36-b99f-e12fb4f2d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.946317 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2055b3-e3e4-4d36-b99f-e12fb4f2d66d admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.946669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2055b3-e3e4-4d36-b99f-e12fb4f2d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.947015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2055b3-e3e4-4d36-b99f-e12fb4f2d66d admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.947735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2055b3-e3e4-4d36-b99f-e12fb4f2d66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.949512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2055b3-e3e4-4d36-b99f-e12fb4f2d66d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.960599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1256/2496] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:51.964727 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd831c-beec-43f5-87b9-fcdf2656e87b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:51.974887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fd831c-beec-43f5-87b9-fcdf2656e87b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:51.980459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea9c9c-fad1-48e2-b7b3-666540a4fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:51.981061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9c9c-fad1-48e2-b7b3-666540a4fd30 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:51.981338 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9c9c-fad1-48e2-b7b3-666540a4fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:51.981672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea9c9c-fad1-48e2-b7b3-666540a4fd30 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:51.983045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea9c9c-fad1-48e2-b7b3-666540a4fd30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:51.984838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea9c9c-fad1-48e2-b7b3-666540a4fd30 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:51.999177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1241/2497] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:52.000330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2055b3-e3e4-4d36-b99f-e12fb4f2d66d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:52.010312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2055b3-e3e4-4d36-b99f-e12fb4f2d66d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:52.014909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f61a7-4d43-4011-97fa-a264d55d770a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:52.015555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f61a7-4d43-4011-97fa-a264d55d770a admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.015835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f61a7-4d43-4011-97fa-a264d55d770a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.016110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3f61a7-4d43-4011-97fa-a264d55d770a admin admin] PATH_INFO: `/v3/projects/942b5ae1c4df4cc0892bb32b0a44ae81/users/b90ef444a5084ff09e8897d05c975e0e/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.030633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f61a7-4d43-4011-97fa-a264d55d770a admin admin] RBAC: Authorizing `identity:create_grant(project_id=942b5ae1c4df4cc0892bb32b0a44ae81, user_id=b90ef444a5084ff09e8897d05c975e0e, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:52.033298 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3f61a7-4d43-4011-97fa-a264d55d770a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:52.046872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1257/2498] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:51 2022] PUT /identity/v3/projects/942b5ae1c4df4cc0892bb32b0a44ae81/users/b90ef444a5084ff09e8897d05c975e0e/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:52.058202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7a9bb-4b0a-47c1-8f59-9e3a47342637 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.058561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7a9bb-4b0a-47c1-8f59-9e3a47342637 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.058843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f7a9bb-4b0a-47c1-8f59-9e3a47342637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.086562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d3f7a9bb-4b0a-47c1-8f59-9e3a47342637 None None] MFA Rules not processed for user `b90ef444a5084ff09e8897d05c975e0e`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:52.087896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d3f7a9bb-4b0a-47c1-8f59-9e3a47342637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:52.152247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1242/2499] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:52.156739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f61a7-4d43-4011-97fa-a264d55d770a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:52.221447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3f61a7-4d43-4011-97fa-a264d55d770a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:52.226116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba530494-a430-4167-8165-ef12ea52a350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:52.226727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba530494-a430-4167-8165-ef12ea52a350 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.227008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba530494-a430-4167-8165-ef12ea52a350 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.227281 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba530494-a430-4167-8165-ef12ea52a350 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.227915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba530494-a430-4167-8165-ef12ea52a350 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:52.230518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba530494-a430-4167-8165-ef12ea52a350 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:52.259926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1258/2500] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:54:52 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:54:52.261009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7a9bb-4b0a-47c1-8f59-9e3a47342637 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:52.271509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f7a9bb-4b0a-47c1-8f59-9e3a47342637 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:52.324603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:52.332265 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a700ab-6395-4063-8c48-3e7d5516bab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:52.333043 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a700ab-6395-4063-8c48-3e7d5516bab4 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.333220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a700ab-6395-4063-8c48-3e7d5516bab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.333527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a700ab-6395-4063-8c48-3e7d5516bab4 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.334173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a700ab-6395-4063-8c48-3e7d5516bab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:52.336403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a700ab-6395-4063-8c48-3e7d5516bab4 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:52.359031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1243/2501] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:54:52 2022] POST /identity/v3/users => generated 299 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:54:52.363190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba530494-a430-4167-8165-ef12ea52a350 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:52.377898 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba530494-a430-4167-8165-ef12ea52a350 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:52.382817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61daaf6-faad-40a7-a65b-bd758ed73535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:52.383743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61daaf6-faad-40a7-a65b-bd758ed73535 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.384022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61daaf6-faad-40a7-a65b-bd758ed73535 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.384294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61daaf6-faad-40a7-a65b-bd758ed73535 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.385027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61daaf6-faad-40a7-a65b-bd758ed73535 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:52.386566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61daaf6-faad-40a7-a65b-bd758ed73535 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:52.398017 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1259/2502] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:54:52.402661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a700ab-6395-4063-8c48-3e7d5516bab4 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:52.413454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a700ab-6395-4063-8c48-3e7d5516bab4 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:52.418046 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70974-f46b-42a0-9d7d-c2557f14106a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:52.418716 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70974-f46b-42a0-9d7d-c2557f14106a admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.418992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70974-f46b-42a0-9d7d-c2557f14106a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.419273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b70974-f46b-42a0-9d7d-c2557f14106a admin admin] PATH_INFO: `/v3/projects/979876b32d3d4d89ac68c50f4a433c55/users/2e3c4a0529484afa88d2a1e99d55cf82/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.437573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70974-f46b-42a0-9d7d-c2557f14106a admin admin] RBAC: Authorizing `identity:create_grant(project_id=979876b32d3d4d89ac68c50f4a433c55, user_id=2e3c4a0529484afa88d2a1e99d55cf82, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:52.440200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b70974-f46b-42a0-9d7d-c2557f14106a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:52.455106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1244/2503] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:52 2022] PUT /identity/v3/projects/979876b32d3d4d89ac68c50f4a433c55/users/2e3c4a0529484afa88d2a1e99d55cf82/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:52.459244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61daaf6-faad-40a7-a65b-bd758ed73535 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:52.470477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61daaf6-faad-40a7-a65b-bd758ed73535 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:52.532441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff34a24-5025-4afa-b0ed-18523bdd41fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:52.533050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff34a24-5025-4afa-b0ed-18523bdd41fd admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.533330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff34a24-5025-4afa-b0ed-18523bdd41fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.533637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff34a24-5025-4afa-b0ed-18523bdd41fd admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.534293 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff34a24-5025-4afa-b0ed-18523bdd41fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:52.535880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff34a24-5025-4afa-b0ed-18523bdd41fd admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:52.554312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1260/2504] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:54:52 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:54:52.558918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70974-f46b-42a0-9d7d-c2557f14106a admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:52.569680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b70974-f46b-42a0-9d7d-c2557f14106a admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:52.576278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd9006-7d42-4ca9-bc0b-89ca6c84d865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:52.577352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd9006-7d42-4ca9-bc0b-89ca6c84d865 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.577352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd9006-7d42-4ca9-bc0b-89ca6c84d865 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.577697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd9006-7d42-4ca9-bc0b-89ca6c84d865 admin admin] PATH_INFO: `/v3/projects/979876b32d3d4d89ac68c50f4a433c55/users/2e3c4a0529484afa88d2a1e99d55cf82/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.579977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd9006-7d42-4ca9-bc0b-89ca6c84d865 admin admin] RBAC: Authorizing `identity:create_grant(project_id=979876b32d3d4d89ac68c50f4a433c55, user_id=2e3c4a0529484afa88d2a1e99d55cf82, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:52.583121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd9006-7d42-4ca9-bc0b-89ca6c84d865 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:52.598469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1245/2505] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:54:52 2022] PUT /identity/v3/projects/979876b32d3d4d89ac68c50f4a433c55/users/2e3c4a0529484afa88d2a1e99d55cf82/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:52.609998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565203ec-0832-4fb8-8d5c-85f85735d69d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.610441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565203ec-0832-4fb8-8d5c-85f85735d69d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.610724 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565203ec-0832-4fb8-8d5c-85f85735d69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.633798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:52.644199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-565203ec-0832-4fb8-8d5c-85f85735d69d None None] MFA Rules not processed for user `2e3c4a0529484afa88d2a1e99d55cf82`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:52.645064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-565203ec-0832-4fb8-8d5c-85f85735d69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:52.730763 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1261/2506] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:52 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:52.753625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd9006-7d42-4ca9-bc0b-89ca6c84d865 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:52.754800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-61cd9006-7d42-4ca9-bc0b-89ca6c84d865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:52.822822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd9006-7d42-4ca9-bc0b-89ca6c84d865 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:52.827052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6487-ffef-4200-9e4f-02cf21c6b042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:52.827674 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6487-ffef-4200-9e4f-02cf21c6b042 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:52.827954 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6487-ffef-4200-9e4f-02cf21c6b042 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:52.828227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c6487-ffef-4200-9e4f-02cf21c6b042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:52.887966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6487-ffef-4200-9e4f-02cf21c6b042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:52.889428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c6487-ffef-4200-9e4f-02cf21c6b042 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:52.898856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1246/2507] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:54.472573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565203ec-0832-4fb8-8d5c-85f85735d69d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:54.483077 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565203ec-0832-4fb8-8d5c-85f85735d69d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:54.487277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e465aa-6e4b-464c-8c5b-c0fa739eade4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:54.487900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e465aa-6e4b-464c-8c5b-c0fa739eade4 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:54.488180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e465aa-6e4b-464c-8c5b-c0fa739eade4 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:54.488454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e465aa-6e4b-464c-8c5b-c0fa739eade4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:54.550473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e465aa-6e4b-464c-8c5b-c0fa739eade4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:54.551924 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e465aa-6e4b-464c-8c5b-c0fa739eade4 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:54.562914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1262/2508] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:55.042644 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6487-ffef-4200-9e4f-02cf21c6b042 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:55.044427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-988c6487-ffef-4200-9e4f-02cf21c6b042 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:55.055819 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c6487-ffef-4200-9e4f-02cf21c6b042 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:55.060414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:55.061648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:55.062106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:55.062540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:55.065353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:55.103584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e465aa-6e4b-464c-8c5b-c0fa739eade4 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:55.114933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e465aa-6e4b-464c-8c5b-c0fa739eade4 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:55.126037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8a8664-016f-4738-a158-14253241e5c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:55.126829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a8664-016f-4738-a158-14253241e5c3 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:55.127783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a8664-016f-4738-a158-14253241e5c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:55.128728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a8664-016f-4738-a158-14253241e5c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:55.138983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a8664-016f-4738-a158-14253241e5c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:55.141225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8a8664-016f-4738-a158-14253241e5c3 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:55.141561 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:55.143039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:55.152362 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1263/2509] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:55 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:55.153918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1247/2510] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:55 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:56.745969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ad616-4474-4d20-8c6b-da86de80083a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:56.747525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ad616-4474-4d20-8c6b-da86de80083a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:56.747813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98ad616-4474-4d20-8c6b-da86de80083a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:56.768211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a98ad616-4474-4d20-8c6b-da86de80083a None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:56.769439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a98ad616-4474-4d20-8c6b-da86de80083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:56.832862 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1264/2511] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 17 00:54:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:54:56.858839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:56.860284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:56.865788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:56.954153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a8faf5-d073-4a46-9395-6c4ba4724f7f service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:56.961554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd79ce79-6725-4c75-b7c2-e131a09ecac2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:56.962429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ce79-6725-4c75-b7c2-e131a09ecac2 service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:56.962803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ce79-6725-4c75-b7c2-e131a09ecac2 service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:56.964320 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd79ce79-6725-4c75-b7c2-e131a09ecac2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:56.981423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79ce79-6725-4c75-b7c2-e131a09ecac2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:56.983096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd79ce79-6725-4c75-b7c2-e131a09ecac2 service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:56.994737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1248/2512] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:54:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:54:57.485986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ad616-4474-4d20-8c6b-da86de80083a None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:57.487593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a98ad616-4474-4d20-8c6b-da86de80083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:57.561976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:57.624089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98ad616-4474-4d20-8c6b-da86de80083a None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:57.633792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:57.634546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:57.634919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:57.635400 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] PATH_INFO: `/v3/users/f998ff3027474caaa723c7d906b140e7` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:57.637276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f998ff3027474caaa723c7d906b140e7)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:57.640938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:57.706348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f998ff3027474caaa723c7d906b140e7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:57.734253 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f998ff3027474caaa723c7d906b140e7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:57.734813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f998ff3027474caaa723c7d906b140e7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:57.761294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f998ff3027474caaa723c7d906b140e7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:57.796302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f998ff3027474caaa723c7d906b140e7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:57.803246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1265/2513] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:57 2022] DELETE /identity/v3/users/f998ff3027474caaa723c7d906b140e7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:57.808248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2bde-1563-4f62-abbe-811094483ecc None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:57.808424 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2bde-1563-4f62-abbe-811094483ecc None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:57.808762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be2bde-1563-4f62-abbe-811094483ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:57.840365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-53be2bde-1563-4f62-abbe-811094483ecc None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:57.841690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-53be2bde-1563-4f62-abbe-811094483ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:57.905783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1249/2514] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:57.918370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:57.920212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:58.009087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34369b0-1da9-417b-9048-d568cdcc30e1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:58.013923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72947ddd-c1f2-4399-873f-277021c35ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:58.014641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72947ddd-c1f2-4399-873f-277021c35ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:58.015108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72947ddd-c1f2-4399-873f-277021c35ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:58.015448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72947ddd-c1f2-4399-873f-277021c35ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:58.026812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72947ddd-c1f2-4399-873f-277021c35ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:58.028330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72947ddd-c1f2-4399-873f-277021c35ad1 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:58.057922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1266/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:54:58.395058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2bde-1563-4f62-abbe-811094483ecc None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:58.396832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-53be2bde-1563-4f62-abbe-811094483ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:58.414677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be2bde-1563-4f62-abbe-811094483ecc None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:58.421445 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:58.422196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:58.422541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:58.422884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] PATH_INFO: `/v3/projects/8454edcf4def4efe807741f4b9bae21d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:58.424122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8454edcf4def4efe807741f4b9bae21d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:58.426222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:58.477241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8454edcf4def4efe807741f4b9bae21d', 'request_id': 'req-751057ad-fe96-4572-a0de-843899ee2807'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.485803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8454edcf4def4efe807741f4b9bae21d', 'request_id': 'req-751057ad-fe96-4572-a0de-843899ee2807'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.491613 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8454edcf4def4efe807741f4b9bae21d', 'request_id': 'req-751057ad-fe96-4572-a0de-843899ee2807'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.503917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] The token cache is being invalidate because project 8454edcf4def4efe807741f4b9bae21d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:58.504216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.504869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.506393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1250/2516] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:58 2022] DELETE /identity/v3/projects/8454edcf4def4efe807741f4b9bae21d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:58.510999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72947ddd-c1f2-4399-873f-277021c35ad1 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:58.521091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72947ddd-c1f2-4399-873f-277021c35ad1 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:58.568409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:58.583977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:58.584609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:58.584887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:58.585160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] PATH_INFO: `/v3/users/88dae0f44ccb482aa0bf100995805124` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:58.586566 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88dae0f44ccb482aa0bf100995805124)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:58.588533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:58.646805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88dae0f44ccb482aa0bf100995805124'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.653949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88dae0f44ccb482aa0bf100995805124'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.654547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88dae0f44ccb482aa0bf100995805124'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.661438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88dae0f44ccb482aa0bf100995805124'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.673827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88dae0f44ccb482aa0bf100995805124'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:58.679689 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1267/2517] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:58 2022] DELETE /identity/v3/users/88dae0f44ccb482aa0bf100995805124 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:58.974795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:58.976303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:58.989531 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751057ad-fe96-4572-a0de-843899ee2807 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:59.000919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:59.047135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:59.047690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:59.047966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:59.048237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] PATH_INFO: `/v3/projects/403d53d448ab449d9b7690361c1f39e5` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:59.049340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403d53d448ab449d9b7690361c1f39e5)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:59.051277 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:59.096006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403d53d448ab449d9b7690361c1f39e5', 'request_id': 'req-01effe71-7627-4a98-8120-89e915e794d5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.102620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403d53d448ab449d9b7690361c1f39e5', 'request_id': 'req-01effe71-7627-4a98-8120-89e915e794d5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.109133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403d53d448ab449d9b7690361c1f39e5', 'request_id': 'req-01effe71-7627-4a98-8120-89e915e794d5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.121188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] The token cache is being invalidate because project 403d53d448ab449d9b7690361c1f39e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:59.121507 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.122144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.123652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1251/2518] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:58 2022] DELETE /identity/v3/projects/403d53d448ab449d9b7690361c1f39e5 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:59.127638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:59.129035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:59.141589 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca624f3c-3f12-4ee7-8a03-574cf56789b0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:59.196573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:59.197205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:59.197533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:59.197844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] PATH_INFO: `/v3/users/ec90438351b6459f9bbbf3aadb1e0110` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:59.198958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec90438351b6459f9bbbf3aadb1e0110)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:59.200879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:59.252074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec90438351b6459f9bbbf3aadb1e0110'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.263476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec90438351b6459f9bbbf3aadb1e0110'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.264128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec90438351b6459f9bbbf3aadb1e0110'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.272696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec90438351b6459f9bbbf3aadb1e0110'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.280117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:59.287768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:59.289369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:59.292533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-75a294f4-22f7-485f-b875-882365d241fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec90438351b6459f9bbbf3aadb1e0110'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.304119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1268/2519] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:59 2022] DELETE /identity/v3/users/ec90438351b6459f9bbbf3aadb1e0110 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:59.311476 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01effe71-7627-4a98-8120-89e915e794d5 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:59.380641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:59.381375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:59.381698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:59.381981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] PATH_INFO: `/v3/users/ebee68a2f0834b69967ac7831593dcb3` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:59.383169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ebee68a2f0834b69967ac7831593dcb3)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:59.386024 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:59.455321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ebee68a2f0834b69967ac7831593dcb3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.457443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:54:59.469578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ebee68a2f0834b69967ac7831593dcb3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.470572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ebee68a2f0834b69967ac7831593dcb3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.491724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ebee68a2f0834b69967ac7831593dcb3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.500137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ebee68a2f0834b69967ac7831593dcb3'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.506895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1252/2520] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:54:59 2022] DELETE /identity/v3/users/ebee68a2f0834b69967ac7831593dcb3 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:54:59.512156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad816-834e-42ad-88cf-86341214dd09 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:59.512446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad816-834e-42ad-88cf-86341214dd09 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:59.512721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818ad816-834e-42ad-88cf-86341214dd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:59.534387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-818ad816-834e-42ad-88cf-86341214dd09 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:59.535609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-818ad816-834e-42ad-88cf-86341214dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:59.599016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1269/2521] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:54:59.608873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:59.610614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:59.674234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1010ba5e-6354-4f06-8b96-c6f32e95bf1e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:59.678158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018376b0-1996-4366-a5c4-48809be6577d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:59.678806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018376b0-1996-4366-a5c4-48809be6577d service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:59.679086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018376b0-1996-4366-a5c4-48809be6577d service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:59.679360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018376b0-1996-4366-a5c4-48809be6577d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:59.689294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018376b0-1996-4366-a5c4-48809be6577d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:59.690796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018376b0-1996-4366-a5c4-48809be6577d service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:59.701761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1253/2522] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:54:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:54:59.774555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad816-834e-42ad-88cf-86341214dd09 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:54:59.776527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-818ad816-834e-42ad-88cf-86341214dd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:54:59.789770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818ad816-834e-42ad-88cf-86341214dd09 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:54:59.796525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:54:59.797585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:59.797970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:59.798420 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] PATH_INFO: `/v3/projects/c2298ae780dc48ad8f2a2ff9561f07ad` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:59.800088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2298ae780dc48ad8f2a2ff9561f07ad)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:54:59.809514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:54:59.877797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2298ae780dc48ad8f2a2ff9561f07ad', 'request_id': 'req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.891803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2298ae780dc48ad8f2a2ff9561f07ad', 'request_id': 'req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.900009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2298ae780dc48ad8f2a2ff9561f07ad', 'request_id': 'req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.916631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] The token cache is being invalidate because project c2298ae780dc48ad8f2a2ff9561f07ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:54:59.917577 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.918553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-7d9a6e23-4d89-4243-94f4-e33cd5b5373f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:54:59.920396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1270/2523] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:54:59 2022] DELETE /identity/v3/projects/c2298ae780dc48ad8f2a2ff9561f07ad => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:54:59.926243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853cc40-fe22-4cbb-a47c-ff686566ab26 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:54:59.926535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853cc40-fe22-4cbb-a47c-ff686566ab26 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:54:59.926817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9853cc40-fe22-4cbb-a47c-ff686566ab26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:54:59.947830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9853cc40-fe22-4cbb-a47c-ff686566ab26 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:54:59.949084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9853cc40-fe22-4cbb-a47c-ff686566ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:00.016553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1254/2524] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:54:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:00.024573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c8088-ab58-407f-8f51-669e7e78deb1 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.025160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c8088-ab58-407f-8f51-669e7e78deb1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.025745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c8088-ab58-407f-8f51-669e7e78deb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.039328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853cc40-fe22-4cbb-a47c-ff686566ab26 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.041100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9853cc40-fe22-4cbb-a47c-ff686566ab26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:00.055441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9853cc40-fe22-4cbb-a47c-ff686566ab26 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.057844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-504c8088-ab58-407f-8f51-669e7e78deb1 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:00.059672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-504c8088-ab58-407f-8f51-669e7e78deb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:00.061205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.062135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.062589 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.063062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] PATH_INFO: `/v3/projects/b403968f1ae44fc6977dde907809925d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.064448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b403968f1ae44fc6977dde907809925d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.066765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.079622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1271/2525] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:00.083138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c8088-ab58-407f-8f51-669e7e78deb1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.093422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c8088-ab58-407f-8f51-669e7e78deb1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.100130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aa4eb-10b6-4470-80ff-4411f20fd6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.103727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aa4eb-10b6-4470-80ff-4411f20fd6e5 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.104138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aa4eb-10b6-4470-80ff-4411f20fd6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.104369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015aa4eb-10b6-4470-80ff-4411f20fd6e5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.105221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015aa4eb-10b6-4470-80ff-4411f20fd6e5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:00.105355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015aa4eb-10b6-4470-80ff-4411f20fd6e5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.106938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015aa4eb-10b6-4470-80ff-4411f20fd6e5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.120626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1272/2526] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:55:00.125350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aa4eb-10b6-4470-80ff-4411f20fd6e5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.135942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015aa4eb-10b6-4470-80ff-4411f20fd6e5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.144008 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b403968f1ae44fc6977dde907809925d', 'request_id': 'req-fdc4be12-257c-49b0-8862-83af3fd0c855'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.153618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b403968f1ae44fc6977dde907809925d', 'request_id': 'req-fdc4be12-257c-49b0-8862-83af3fd0c855'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.159003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:00.160650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b403968f1ae44fc6977dde907809925d', 'request_id': 'req-fdc4be12-257c-49b0-8862-83af3fd0c855'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.174022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] The token cache is being invalidate because project b403968f1ae44fc6977dde907809925d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:00.174382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.175214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.179294 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1255/2527] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:00 2022] DELETE /identity/v3/projects/b403968f1ae44fc6977dde907809925d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:00.182996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.184379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:00.203740 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:00.219191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f69d86-57cf-45af-b991-3b7636c0c20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.220025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f69d86-57cf-45af-b991-3b7636c0c20b admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.220431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f69d86-57cf-45af-b991-3b7636c0c20b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.221552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f69d86-57cf-45af-b991-3b7636c0c20b admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.221764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f69d86-57cf-45af-b991-3b7636c0c20b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.224276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f69d86-57cf-45af-b991-3b7636c0c20b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.256615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1273/2528] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:00 2022] POST /identity/v3/projects => generated 383 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:00.261094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc4be12-257c-49b0-8862-83af3fd0c855 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.261318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f69d86-57cf-45af-b991-3b7636c0c20b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.262972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-58f69d86-57cf-45af-b991-3b7636c0c20b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:00.320876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.321586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.321871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.322147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] PATH_INFO: `/v3/users/b90ef444a5084ff09e8897d05c975e0e` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.324375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b90ef444a5084ff09e8897d05c975e0e)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.326419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.328801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f69d86-57cf-45af-b991-3b7636c0c20b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.333708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dd97b-37b3-403a-be76-16346e373984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.334312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dd97b-37b3-403a-be76-16346e373984 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.334745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dd97b-37b3-403a-be76-16346e373984 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.335021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8dd97b-37b3-403a-be76-16346e373984 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.335659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dd97b-37b3-403a-be76-16346e373984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.338018 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8dd97b-37b3-403a-be76-16346e373984 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.361185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1274/2529] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:00 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:00.365543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dd97b-37b3-403a-be76-16346e373984 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.376023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8dd97b-37b3-403a-be76-16346e373984 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.377091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b90ef444a5084ff09e8897d05c975e0e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.380779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb81db-00bb-40c2-8fff-15876c30349a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.381428 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb81db-00bb-40c2-8fff-15876c30349a admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.381764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb81db-00bb-40c2-8fff-15876c30349a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.382114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb81db-00bb-40c2-8fff-15876c30349a admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.382848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb81db-00bb-40c2-8fff-15876c30349a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.384595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb81db-00bb-40c2-8fff-15876c30349a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.384909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b90ef444a5084ff09e8897d05c975e0e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.386169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b90ef444a5084ff09e8897d05c975e0e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.399641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1275/2530] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:00.400531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb81db-00bb-40c2-8fff-15876c30349a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.403068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-63eb81db-00bb-40c2-8fff-15876c30349a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:00.404603 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b90ef444a5084ff09e8897d05c975e0e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.418393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb81db-00bb-40c2-8fff-15876c30349a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.418578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b90ef444a5084ff09e8897d05c975e0e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.423633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de7ed7-c059-4ee7-aaaa-454630e770cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.424262 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7ed7-c059-4ee7-aaaa-454630e770cb admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.424539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7ed7-c059-4ee7-aaaa-454630e770cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.424809 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de7ed7-c059-4ee7-aaaa-454630e770cb admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.425367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1256/2531] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:00 2022] DELETE /identity/v3/users/b90ef444a5084ff09e8897d05c975e0e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:00.428610 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7ed7-c059-4ee7-aaaa-454630e770cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.430120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de7ed7-c059-4ee7-aaaa-454630e770cb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.442103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1276/2532] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:00.446234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.466033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:00.512247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf576e-2b3c-467f-a2c2-20ef4372e043 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.517006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8692bf-fe34-4e05-b114-9b7b75baf728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.517699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8692bf-fe34-4e05-b114-9b7b75baf728 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.517981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8692bf-fe34-4e05-b114-9b7b75baf728 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.518252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8692bf-fe34-4e05-b114-9b7b75baf728 admin admin] PATH_INFO: `/v3/projects/8808464f9858470caf42a0a59a5b4818/users/1397f55800ca46348764ff8151a5cfd8/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.534665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8692bf-fe34-4e05-b114-9b7b75baf728 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8808464f9858470caf42a0a59a5b4818, user_id=1397f55800ca46348764ff8151a5cfd8, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.537328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8692bf-fe34-4e05-b114-9b7b75baf728 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.551976 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1257/2533] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:00 2022] PUT /identity/v3/projects/8808464f9858470caf42a0a59a5b4818/users/1397f55800ca46348764ff8151a5cfd8/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:00.563622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a012805-4ff9-4f2a-be8d-d90e2c9102db None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.564173 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a012805-4ff9-4f2a-be8d-d90e2c9102db None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.564633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a012805-4ff9-4f2a-be8d-d90e2c9102db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.600095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3a012805-4ff9-4f2a-be8d-d90e2c9102db None None] MFA Rules not processed for user `1397f55800ca46348764ff8151a5cfd8`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:00.601426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3a012805-4ff9-4f2a-be8d-d90e2c9102db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:00.666525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1277/2534] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:00.678549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8692bf-fe34-4e05-b114-9b7b75baf728 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.680261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3a8692bf-fe34-4e05-b114-9b7b75baf728 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:00.712655 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a012805-4ff9-4f2a-be8d-d90e2c9102db None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.714569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3a012805-4ff9-4f2a-be8d-d90e2c9102db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:00.749283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8692bf-fe34-4e05-b114-9b7b75baf728 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.753058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f059a-6e64-44d0-a8eb-d6f440661c0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.753890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f059a-6e64-44d0-a8eb-d6f440661c0a service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.754176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f059a-6e64-44d0-a8eb-d6f440661c0a service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.754457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f059a-6e64-44d0-a8eb-d6f440661c0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.759214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:00.765051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f059a-6e64-44d0-a8eb-d6f440661c0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.766725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f059a-6e64-44d0-a8eb-d6f440661c0a service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.775941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1258/2535] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:00.791051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a012805-4ff9-4f2a-be8d-d90e2c9102db None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.795775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.796404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.796704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.797009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] PATH_INFO: `/v3/projects/942b5ae1c4df4cc0892bb32b0a44ae81` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.798186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=942b5ae1c4df4cc0892bb32b0a44ae81)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.800605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:00.849689 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942b5ae1c4df4cc0892bb32b0a44ae81', 'request_id': 'req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.857725 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942b5ae1c4df4cc0892bb32b0a44ae81', 'request_id': 'req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.864005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942b5ae1c4df4cc0892bb32b0a44ae81', 'request_id': 'req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.876941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] The token cache is being invalidate because project 942b5ae1c4df4cc0892bb32b0a44ae81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:00.877231 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.877917 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:00.879473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1278/2536] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:00 2022] DELETE /identity/v3/projects/942b5ae1c4df4cc0892bb32b0a44ae81 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:00.883480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f059a-6e64-44d0-a8eb-d6f440661c0a service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:00.894622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f059a-6e64-44d0-a8eb-d6f440661c0a service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:00.953980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:00.954611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:00.954887 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:00.955187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] PATH_INFO: `/v3/users/2e3c4a0529484afa88d2a1e99d55cf82` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:00.956355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e3c4a0529484afa88d2a1e99d55cf82)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:00.958254 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:01.006300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:01.008278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e3c4a0529484afa88d2a1e99d55cf82'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.017442 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e3c4a0529484afa88d2a1e99d55cf82'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.019064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e3c4a0529484afa88d2a1e99d55cf82'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.034906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e3c4a0529484afa88d2a1e99d55cf82'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.043288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8a32477-b87e-472f-a39f-d5b359472858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e3c4a0529484afa88d2a1e99d55cf82'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.049536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1259/2537] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:00 2022] DELETE /identity/v3/users/2e3c4a0529484afa88d2a1e99d55cf82 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:01.342272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:01.344146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:01.359734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2aea63-0d23-4e6e-a5e4-5f9e300465a5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:01.422287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:01.422932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.423210 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.423483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] PATH_INFO: `/v3/projects/979876b32d3d4d89ac68c50f4a433c55` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.424746 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=979876b32d3d4d89ac68c50f4a433c55)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:01.426726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:01.474256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '979876b32d3d4d89ac68c50f4a433c55', 'request_id': 'req-ad54d27a-3eab-4917-ac73-fcf83d804dc7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.481828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '979876b32d3d4d89ac68c50f4a433c55', 'request_id': 'req-ad54d27a-3eab-4917-ac73-fcf83d804dc7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.487880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '979876b32d3d4d89ac68c50f4a433c55', 'request_id': 'req-ad54d27a-3eab-4917-ac73-fcf83d804dc7'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.489012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:01.500808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] The token cache is being invalidate because project 979876b32d3d4d89ac68c50f4a433c55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:01.501159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.501833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-ad54d27a-3eab-4917-ac73-fcf83d804dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:01.503423 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1279/2538] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:01 2022] DELETE /identity/v3/projects/979876b32d3d4d89ac68c50f4a433c55 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:01.508415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e6d3-76ed-43b1-854e-5af0405d2048 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.508697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e6d3-76ed-43b1-854e-5af0405d2048 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.508967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c07e6d3-76ed-43b1-854e-5af0405d2048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.529184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0c07e6d3-76ed-43b1-854e-5af0405d2048 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:01.530444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0c07e6d3-76ed-43b1-854e-5af0405d2048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:01.592790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1260/2539] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:01.600729 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859a5f-2b75-43ba-8822-2fe1c8965524 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.601021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859a5f-2b75-43ba-8822-2fe1c8965524 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.601299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72859a5f-2b75-43ba-8822-2fe1c8965524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.622136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-72859a5f-2b75-43ba-8822-2fe1c8965524 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:01.623338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-72859a5f-2b75-43ba-8822-2fe1c8965524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:01.631089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1280/2540] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:01.635735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e6d3-76ed-43b1-854e-5af0405d2048 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:01.645393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c07e6d3-76ed-43b1-854e-5af0405d2048 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:01.650057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe90c1-fe1a-49c3-afb8-aa8f77025934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:01.650655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe90c1-fe1a-49c3-afb8-aa8f77025934 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.651550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe90c1-fe1a-49c3-afb8-aa8f77025934 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.651832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befe90c1-fe1a-49c3-afb8-aa8f77025934 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.652503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe90c1-fe1a-49c3-afb8-aa8f77025934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:01.652808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe90c1-fe1a-49c3-afb8-aa8f77025934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:01.654450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befe90c1-fe1a-49c3-afb8-aa8f77025934 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:01.665789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1261/2541] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:01.670168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859a5f-2b75-43ba-8822-2fe1c8965524 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:01.679841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72859a5f-2b75-43ba-8822-2fe1c8965524 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:01.684623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3063d-facd-40f6-8b2a-a2f82cc85c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:01.685216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3063d-facd-40f6-8b2a-a2f82cc85c7e admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.685545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3063d-facd-40f6-8b2a-a2f82cc85c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.685824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d3063d-facd-40f6-8b2a-a2f82cc85c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.686467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3063d-facd-40f6-8b2a-a2f82cc85c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:01.688369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d3063d-facd-40f6-8b2a-a2f82cc85c7e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:01.715555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1281/2542] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:01 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:01.719683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe90c1-fe1a-49c3-afb8-aa8f77025934 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:01.729747 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befe90c1-fe1a-49c3-afb8-aa8f77025934 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:01.783860 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e1be-5ddf-4bd1-82ff-42da5dcaead4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:01.784487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e1be-5ddf-4bd1-82ff-42da5dcaead4 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.784763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e1be-5ddf-4bd1-82ff-42da5dcaead4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.785034 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1e1be-5ddf-4bd1-82ff-42da5dcaead4 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.785729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1e1be-5ddf-4bd1-82ff-42da5dcaead4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:01.787636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e1e1be-5ddf-4bd1-82ff-42da5dcaead4 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:01.808161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1262/2543] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:01 2022] POST /identity/v3/users => generated 287 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:01.812312 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3063d-facd-40f6-8b2a-a2f82cc85c7e admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:01.823737 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d3063d-facd-40f6-8b2a-a2f82cc85c7e admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:01.829237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83760f-f180-4a27-ab86-4ab6c2fc7269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:01.829983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83760f-f180-4a27-ab86-4ab6c2fc7269 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.830330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83760f-f180-4a27-ab86-4ab6c2fc7269 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.830669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83760f-f180-4a27-ab86-4ab6c2fc7269 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.831391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83760f-f180-4a27-ab86-4ab6c2fc7269 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:01.832987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83760f-f180-4a27-ab86-4ab6c2fc7269 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:01.844073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1282/2544] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:01.848140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e1be-5ddf-4bd1-82ff-42da5dcaead4 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:01.858138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e1e1be-5ddf-4bd1-82ff-42da5dcaead4 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:01.862769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455b3b5-3a8b-479e-baad-99266b997fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:01.863362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455b3b5-3a8b-479e-baad-99266b997fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.863642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455b3b5-3a8b-479e-baad-99266b997fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.863918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455b3b5-3a8b-479e-baad-99266b997fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.864553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455b3b5-3a8b-479e-baad-99266b997fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:01.866188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455b3b5-3a8b-479e-baad-99266b997fc0 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:01.876576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1263/2545] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:01 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:01.880615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83760f-f180-4a27-ab86-4ab6c2fc7269 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:01.891319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83760f-f180-4a27-ab86-4ab6c2fc7269 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:01.895873 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5ffa3-c232-4a91-b75d-2f45505c6935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:01.896508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5ffa3-c232-4a91-b75d-2f45505c6935 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.896786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5ffa3-c232-4a91-b75d-2f45505c6935 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.897060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d5ffa3-c232-4a91-b75d-2f45505c6935 admin admin] PATH_INFO: `/v3/projects/364e976131a741b7b7680a938f5ed70d/users/b16db8c9b37f40faa002f48ddcc69847/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.912050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5ffa3-c232-4a91-b75d-2f45505c6935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=364e976131a741b7b7680a938f5ed70d, user_id=b16db8c9b37f40faa002f48ddcc69847, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:01.914811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d5ffa3-c232-4a91-b75d-2f45505c6935 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:01.927310 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1283/2546] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:01 2022] PUT /identity/v3/projects/364e976131a741b7b7680a938f5ed70d/users/b16db8c9b37f40faa002f48ddcc69847/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:01.932904 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21330-97db-4241-9d1e-f5076d260cf5 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:01.933185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21330-97db-4241-9d1e-f5076d260cf5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:01.933491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21330-97db-4241-9d1e-f5076d260cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:01.952377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f4d21330-97db-4241-9d1e-f5076d260cf5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:01.953588 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f4d21330-97db-4241-9d1e-f5076d260cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:01.976676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:02.014567 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1264/2547] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:02.023980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5ffa3-c232-4a91-b75d-2f45505c6935 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:02.025712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-37d5ffa3-c232-4a91-b75d-2f45505c6935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:02.083130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d5ffa3-c232-4a91-b75d-2f45505c6935 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:02.087348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873cc3c6-8d9a-4170-a14c-7e986215240b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:02.087946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cc3c6-8d9a-4170-a14c-7e986215240b service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:02.088269 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cc3c6-8d9a-4170-a14c-7e986215240b service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:02.088562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873cc3c6-8d9a-4170-a14c-7e986215240b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:02.097872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cc3c6-8d9a-4170-a14c-7e986215240b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:02.099328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873cc3c6-8d9a-4170-a14c-7e986215240b service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:02.108995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1284/2548] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:03.356181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21330-97db-4241-9d1e-f5076d260cf5 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:03.357776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f4d21330-97db-4241-9d1e-f5076d260cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:03.373492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21330-97db-4241-9d1e-f5076d260cf5 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:03.379683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:03.381834 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:03.382167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:03.382549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] PATH_INFO: `/v3/users/1397f55800ca46348764ff8151a5cfd8` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:03.384045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1397f55800ca46348764ff8151a5cfd8)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:03.386972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:03.480296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1397f55800ca46348764ff8151a5cfd8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:03.492537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1397f55800ca46348764ff8151a5cfd8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:03.493307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1397f55800ca46348764ff8151a5cfd8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:03.518116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1397f55800ca46348764ff8151a5cfd8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:03.527526 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1397f55800ca46348764ff8151a5cfd8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:03.538111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1265/2549] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:03 2022] DELETE /identity/v3/users/1397f55800ca46348764ff8151a5cfd8 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:03.539385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f2a8-0043-4e1d-83ea-a6b4b2156451 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:03.539823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f2a8-0043-4e1d-83ea-a6b4b2156451 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:03.539918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88f2a8-0043-4e1d-83ea-a6b4b2156451 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:03.568586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-1d88f2a8-0043-4e1d-83ea-a6b4b2156451 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:03.570097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1d88f2a8-0043-4e1d-83ea-a6b4b2156451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:03.668357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1285/2550] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:03.684729 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:03.690735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:03.814331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e865b3ce-c010-443c-be19-84da613dd4d1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:03.824527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a936e40-daf4-46bf-8629-ef3ab37f2076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:03.825240 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a936e40-daf4-46bf-8629-ef3ab37f2076 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:03.825517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a936e40-daf4-46bf-8629-ef3ab37f2076 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:03.825793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a936e40-daf4-46bf-8629-ef3ab37f2076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:03.840754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a936e40-daf4-46bf-8629-ef3ab37f2076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:03.842492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a936e40-daf4-46bf-8629-ef3ab37f2076 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:03.859159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1266/2551] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:03.908883 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88f2a8-0043-4e1d-83ea-a6b4b2156451 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:03.911349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1d88f2a8-0043-4e1d-83ea-a6b4b2156451 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:03.924863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88f2a8-0043-4e1d-83ea-a6b4b2156451 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:03.933473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89c4053-afdb-4b9c-88d5-9e032b61fb75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:03.934026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c4053-afdb-4b9c-88d5-9e032b61fb75 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:03.934408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c4053-afdb-4b9c-88d5-9e032b61fb75 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:03.934768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89c4053-afdb-4b9c-88d5-9e032b61fb75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:03.936730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a89c4053-afdb-4b9c-88d5-9e032b61fb75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:03.951174 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c4053-afdb-4b9c-88d5-9e032b61fb75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:03.952665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89c4053-afdb-4b9c-88d5-9e032b61fb75 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:03.965192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1286/2552] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:04.617098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a936e40-daf4-46bf-8629-ef3ab37f2076 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:04.620230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7a936e40-daf4-46bf-8629-ef3ab37f2076 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:04.638956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a936e40-daf4-46bf-8629-ef3ab37f2076 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:04.645816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:04.646993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:04.647429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:04.647874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] PATH_INFO: `/v3/projects/8808464f9858470caf42a0a59a5b4818` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:04.649530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8808464f9858470caf42a0a59a5b4818)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:04.655127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:04.714083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:04.727946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8808464f9858470caf42a0a59a5b4818', 'request_id': 'req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:04.737156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8808464f9858470caf42a0a59a5b4818', 'request_id': 'req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:04.745736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8808464f9858470caf42a0a59a5b4818', 'request_id': 'req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:04.761579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] The token cache is being invalidate because project 8808464f9858470caf42a0a59a5b4818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:04.762121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:04.762984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ed2122c8-82f1-4cc5-a039-db0e6fcf27d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:04.765009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1267/2553] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:04 2022] DELETE /identity/v3/projects/8808464f9858470caf42a0a59a5b4818 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:04.770013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d0d4-7e1e-43cd-b5e2-544f92253fab None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:04.770966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d0d4-7e1e-43cd-b5e2-544f92253fab None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:04.771393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3d0d4-7e1e-43cd-b5e2-544f92253fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:04.811371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-60d3d0d4-7e1e-43cd-b5e2-544f92253fab None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:04.816771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-60d3d0d4-7e1e-43cd-b5e2-544f92253fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:04.859585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:04.961841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1287/2554] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:04.969661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcc488-0c00-4047-aea3-063d95ed63e0 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:04.969963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcc488-0c00-4047-aea3-063d95ed63e0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:04.970367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbcc488-0c00-4047-aea3-063d95ed63e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:05.008756 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3fbcc488-0c00-4047-aea3-063d95ed63e0 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:05.012618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3fbcc488-0c00-4047-aea3-063d95ed63e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:05.043258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1268/2555] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:05.044586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d0d4-7e1e-43cd-b5e2-544f92253fab None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:05.061767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3d0d4-7e1e-43cd-b5e2-544f92253fab None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:05.077923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36393bf9-7918-49f9-aba3-5b5b2a7e59b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:05.078903 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36393bf9-7918-49f9-aba3-5b5b2a7e59b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:05.079412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36393bf9-7918-49f9-aba3-5b5b2a7e59b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:05.079759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36393bf9-7918-49f9-aba3-5b5b2a7e59b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:05.080643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36393bf9-7918-49f9-aba3-5b5b2a7e59b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:05.080882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36393bf9-7918-49f9-aba3-5b5b2a7e59b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:05.083072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36393bf9-7918-49f9-aba3-5b5b2a7e59b5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:05.109580 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1288/2556] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:05.110831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcc488-0c00-4047-aea3-063d95ed63e0 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:05.122858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbcc488-0c00-4047-aea3-063d95ed63e0 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:05.129196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae420db-5bcb-434c-afff-eae83ddef706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:05.130050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae420db-5bcb-434c-afff-eae83ddef706 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:05.130823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae420db-5bcb-434c-afff-eae83ddef706 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:05.131590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae420db-5bcb-434c-afff-eae83ddef706 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:05.132490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae420db-5bcb-434c-afff-eae83ddef706 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:05.147793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae420db-5bcb-434c-afff-eae83ddef706 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:05.206042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1269/2557] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:05 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:05.206584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36393bf9-7918-49f9-aba3-5b5b2a7e59b5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:05.223003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36393bf9-7918-49f9-aba3-5b5b2a7e59b5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:05.384418 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe05348-ef56-429b-8671-cac606e4b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:05.385308 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe05348-ef56-429b-8671-cac606e4b1e6 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:05.385780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe05348-ef56-429b-8671-cac606e4b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:05.386227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe05348-ef56-429b-8671-cac606e4b1e6 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:05.387027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe05348-ef56-429b-8671-cac606e4b1e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:05.390944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe05348-ef56-429b-8671-cac606e4b1e6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:05.457740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae420db-5bcb-434c-afff-eae83ddef706 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:05.459923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1289/2558] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:05 2022] POST /identity/v3/users => generated 287 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:05.471664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae420db-5bcb-434c-afff-eae83ddef706 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:05.486755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf00e-75ae-4524-ac48-985a0a7ff7d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:05.487685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf00e-75ae-4524-ac48-985a0a7ff7d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:05.488234 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf00e-75ae-4524-ac48-985a0a7ff7d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:05.488838 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895bf00e-75ae-4524-ac48-985a0a7ff7d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:05.490726 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bf00e-75ae-4524-ac48-985a0a7ff7d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:05.492648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895bf00e-75ae-4524-ac48-985a0a7ff7d2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:05.510652 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe05348-ef56-429b-8671-cac606e4b1e6 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:05.518184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1270/2559] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:05.524595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe05348-ef56-429b-8671-cac606e4b1e6 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:05.530444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2f18e-eabc-4086-a510-fd055b81b5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:05.532703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f18e-eabc-4086-a510-fd055b81b5d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:05.533597 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f18e-eabc-4086-a510-fd055b81b5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:05.535194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2f18e-eabc-4086-a510-fd055b81b5d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:05.536040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2f18e-eabc-4086-a510-fd055b81b5d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:05.538330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2f18e-eabc-4086-a510-fd055b81b5d3 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:05.553342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1290/2560] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:05.557713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf00e-75ae-4524-ac48-985a0a7ff7d2 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:05.576096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895bf00e-75ae-4524-ac48-985a0a7ff7d2 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:05.594117 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbc055-3df5-41b2-bfa5-9d983c6c0feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:05.595545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbc055-3df5-41b2-bfa5-9d983c6c0feb admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:05.595829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbc055-3df5-41b2-bfa5-9d983c6c0feb admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:05.596107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cbc055-3df5-41b2-bfa5-9d983c6c0feb admin admin] PATH_INFO: `/v3/projects/ee541330092648bfa69a0afe94215875/users/25f373d364c041c28e732326525169a6/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:05.632910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbc055-3df5-41b2-bfa5-9d983c6c0feb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee541330092648bfa69a0afe94215875, user_id=25f373d364c041c28e732326525169a6, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:05.637184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cbc055-3df5-41b2-bfa5-9d983c6c0feb admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:05.662456 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1271/2561] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:05 2022] PUT /identity/v3/projects/ee541330092648bfa69a0afe94215875/users/25f373d364c041c28e732326525169a6/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:05.673136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3824-81c6-4f03-ada5-0fbc7379ca31 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:05.673440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3824-81c6-4f03-ada5-0fbc7379ca31 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:05.673722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e3824-81c6-4f03-ada5-0fbc7379ca31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:05.728304 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3a1e3824-81c6-4f03-ada5-0fbc7379ca31 None None] MFA Rules not processed for user `25f373d364c041c28e732326525169a6`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:05.736240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3a1e3824-81c6-4f03-ada5-0fbc7379ca31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:05.832249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1291/2562] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:05.843471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbc055-3df5-41b2-bfa5-9d983c6c0feb admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:05.848471 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-25cbc055-3df5-41b2-bfa5-9d983c6c0feb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:05.939635 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cbc055-3df5-41b2-bfa5-9d983c6c0feb admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:05.944687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df85f5-684e-4e90-bca7-37213e4d36ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:05.944883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df85f5-684e-4e90-bca7-37213e4d36ff service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:05.945107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df85f5-684e-4e90-bca7-37213e4d36ff service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:05.945380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df85f5-684e-4e90-bca7-37213e4d36ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:05.956517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df85f5-684e-4e90-bca7-37213e4d36ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:05.958155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0df85f5-684e-4e90-bca7-37213e4d36ff service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:05.969848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1272/2563] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:07.249233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa29e1-37e8-4287-9c23-1ac5685daca4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:07.249688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa29e1-37e8-4287-9c23-1ac5685daca4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:07.251592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa29e1-37e8-4287-9c23-1ac5685daca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:07.299507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-48fa29e1-37e8-4287-9c23-1ac5685daca4 None None] MFA Rules not processed for user `b16db8c9b37f40faa002f48ddcc69847`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:07.303609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-48fa29e1-37e8-4287-9c23-1ac5685daca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:07.310122 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:07.419644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1292/2564] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:07.424037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df85f5-684e-4e90-bca7-37213e4d36ff service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:07.426079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a0df85f5-684e-4e90-bca7-37213e4d36ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:07.504047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0df85f5-684e-4e90-bca7-37213e4d36ff service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:07.508784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594cd9a-e051-46f4-9787-1b9b65ecb456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:07.509515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594cd9a-e051-46f4-9787-1b9b65ecb456 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:07.509859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594cd9a-e051-46f4-9787-1b9b65ecb456 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:07.510524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594cd9a-e051-46f4-9787-1b9b65ecb456 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:07.511416 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594cd9a-e051-46f4-9787-1b9b65ecb456 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:07.513424 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594cd9a-e051-46f4-9787-1b9b65ecb456 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:07.528281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:07.555144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1273/2565] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:07 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:07.556559 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa29e1-37e8-4287-9c23-1ac5685daca4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:07.571747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa29e1-37e8-4287-9c23-1ac5685daca4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:07.636361 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a7f800-2fd7-48eb-8719-7b6628cea6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:07.637004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7f800-2fd7-48eb-8719-7b6628cea6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:07.637288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7f800-2fd7-48eb-8719-7b6628cea6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:07.637609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a7f800-2fd7-48eb-8719-7b6628cea6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:07.638271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7f800-2fd7-48eb-8719-7b6628cea6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:07.640381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a7f800-2fd7-48eb-8719-7b6628cea6d1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:07.673363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1293/2566] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:07 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:07.677754 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594cd9a-e051-46f4-9787-1b9b65ecb456 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:07.725355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631796ea-adaa-41d5-972f-336416a9f7d4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:07.725687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631796ea-adaa-41d5-972f-336416a9f7d4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:07.726398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631796ea-adaa-41d5-972f-336416a9f7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:07.731457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594cd9a-e051-46f4-9787-1b9b65ecb456 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:07.748438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdb721-40eb-49b0-8514-fe80256282e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:07.750070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdb721-40eb-49b0-8514-fe80256282e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:07.750357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdb721-40eb-49b0-8514-fe80256282e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:07.750637 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fdb721-40eb-49b0-8514-fe80256282e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:07.751307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdb721-40eb-49b0-8514-fe80256282e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:07.752981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10fdb721-40eb-49b0-8514-fe80256282e1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:07.775300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1274/2567] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:07.776491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdb721-40eb-49b0-8514-fe80256282e1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:07.779021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-631796ea-adaa-41d5-972f-336416a9f7d4 None None] MFA Rules not processed for user `25f373d364c041c28e732326525169a6`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:07.780548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-631796ea-adaa-41d5-972f-336416a9f7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:07.795528 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10fdb721-40eb-49b0-8514-fe80256282e1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:07.827642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a45f2-d6fc-40ce-83c6-28652e402927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:07.829222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a45f2-d6fc-40ce-83c6-28652e402927 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:07.839091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a45f2-d6fc-40ce-83c6-28652e402927 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:07.839625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567a45f2-d6fc-40ce-83c6-28652e402927 admin admin] PATH_INFO: `/v3/projects/f1f606d769ef407a8c5ef1b6846e2e31/users/3d15eaa485b947cc828fd5058ceab012/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:07.866595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a45f2-d6fc-40ce-83c6-28652e402927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f606d769ef407a8c5ef1b6846e2e31, user_id=3d15eaa485b947cc828fd5058ceab012, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:07.870690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567a45f2-d6fc-40ce-83c6-28652e402927 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:07.875424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1294/2568] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:07.901841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1275/2569] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:07 2022] PUT /identity/v3/projects/f1f606d769ef407a8c5ef1b6846e2e31/users/3d15eaa485b947cc828fd5058ceab012/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:07.906104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631796ea-adaa-41d5-972f-336416a9f7d4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:07.923306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631796ea-adaa-41d5-972f-336416a9f7d4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:08.032984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:08.067104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085fc4a-faca-4079-84e1-cea15402c946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:08.067967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085fc4a-faca-4079-84e1-cea15402c946 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:08.068408 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085fc4a-faca-4079-84e1-cea15402c946 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:08.068837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085fc4a-faca-4079-84e1-cea15402c946 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:08.069704 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085fc4a-faca-4079-84e1-cea15402c946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:08.071496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085fc4a-faca-4079-84e1-cea15402c946 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:08.091615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1295/2570] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:07 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:08.096151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a45f2-d6fc-40ce-83c6-28652e402927 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:08.115059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567a45f2-d6fc-40ce-83c6-28652e402927 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:08.127062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094da7-a0dd-4638-9916-7f8811728bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:08.127711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094da7-a0dd-4638-9916-7f8811728bcb admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:08.127989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094da7-a0dd-4638-9916-7f8811728bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:08.128259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c094da7-a0dd-4638-9916-7f8811728bcb admin admin] PATH_INFO: `/v3/projects/f1f606d769ef407a8c5ef1b6846e2e31/users/3d15eaa485b947cc828fd5058ceab012/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:08.130341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c094da7-a0dd-4638-9916-7f8811728bcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1f606d769ef407a8c5ef1b6846e2e31, user_id=3d15eaa485b947cc828fd5058ceab012, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:08.133052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c094da7-a0dd-4638-9916-7f8811728bcb admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:08.151994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1276/2571] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:08 2022] PUT /identity/v3/projects/f1f606d769ef407a8c5ef1b6846e2e31/users/3d15eaa485b947cc828fd5058ceab012/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:09.031194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085fc4a-faca-4079-84e1-cea15402c946 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:09.033854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6085fc4a-faca-4079-84e1-cea15402c946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:09.055401 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085fc4a-faca-4079-84e1-cea15402c946 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:09.122817 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:09.123812 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:09.124159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:09.124438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] PATH_INFO: `/v3/users/e33cf9baa72248739f58cb3a3d7d078b` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:09.125723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e33cf9baa72248739f58cb3a3d7d078b)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:09.127719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:09.188168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e33cf9baa72248739f58cb3a3d7d078b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.196216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e33cf9baa72248739f58cb3a3d7d078b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.196940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e33cf9baa72248739f58cb3a3d7d078b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.208649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e33cf9baa72248739f58cb3a3d7d078b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.228429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e92a4013-a046-4892-9a0c-0bfd9345632c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e33cf9baa72248739f58cb3a3d7d078b'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.235315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1296/2572] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:09 2022] DELETE /identity/v3/users/e33cf9baa72248739f58cb3a3d7d078b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:09.475302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094da7-a0dd-4638-9916-7f8811728bcb admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:09.484083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-6c094da7-a0dd-4638-9916-7f8811728bcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:09.515799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c094da7-a0dd-4638-9916-7f8811728bcb admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:09.663751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:09.665895 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:09.666901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:09.668595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] PATH_INFO: `/v3/projects/bf431bb930644348bef88df6766f9e31` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:09.672204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf431bb930644348bef88df6766f9e31)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:09.678150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:09.768332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf431bb930644348bef88df6766f9e31', 'request_id': 'req-40f83957-81f2-4ec1-9627-cb10b3c54f40'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.782220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf431bb930644348bef88df6766f9e31', 'request_id': 'req-40f83957-81f2-4ec1-9627-cb10b3c54f40'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.797535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf431bb930644348bef88df6766f9e31', 'request_id': 'req-40f83957-81f2-4ec1-9627-cb10b3c54f40'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.812459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] The token cache is being invalidate because project bf431bb930644348bef88df6766f9e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:09.813007 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.814493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40f83957-81f2-4ec1-9627-cb10b3c54f40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:09.817181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1277/2573] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:09 2022] DELETE /identity/v3/projects/bf431bb930644348bef88df6766f9e31 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:09.821876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9f680-232c-4001-a143-99ce0a87c1bf None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:09.822280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9f680-232c-4001-a143-99ce0a87c1bf None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:09.823190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d9f680-232c-4001-a143-99ce0a87c1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:09.873653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-03d9f680-232c-4001-a143-99ce0a87c1bf None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:09.875156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-03d9f680-232c-4001-a143-99ce0a87c1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:09.970989 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:09.987865 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1297/2574] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:09.997829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fa843-376c-4d7b-8b25-ebadc211a18e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:09.998116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fa843-376c-4d7b-8b25-ebadc211a18e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:09.998395 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fa843-376c-4d7b-8b25-ebadc211a18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:10.034530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e80fa843-376c-4d7b-8b25-ebadc211a18e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:10.035979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e80fa843-376c-4d7b-8b25-ebadc211a18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:10.046118 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1278/2575] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:10.049943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9f680-232c-4001-a143-99ce0a87c1bf None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:10.067591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d9f680-232c-4001-a143-99ce0a87c1bf None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:10.079297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af621c-ab1a-457a-b499-f2cf46d90adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:10.084319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af621c-ab1a-457a-b499-f2cf46d90adb admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:10.084872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af621c-ab1a-457a-b499-f2cf46d90adb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:10.085297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15af621c-ab1a-457a-b499-f2cf46d90adb admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:10.086598 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af621c-ab1a-457a-b499-f2cf46d90adb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:10.087096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af621c-ab1a-457a-b499-f2cf46d90adb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:10.088997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15af621c-ab1a-457a-b499-f2cf46d90adb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:10.122042 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1298/2576] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:10.127702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fa843-376c-4d7b-8b25-ebadc211a18e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:10.145216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fa843-376c-4d7b-8b25-ebadc211a18e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:10.160324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3fc5-fef3-43c2-9c34-81126581a80d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:10.161319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3fc5-fef3-43c2-9c34-81126581a80d admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:10.161907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3fc5-fef3-43c2-9c34-81126581a80d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:10.162347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a3fc5-fef3-43c2-9c34-81126581a80d admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:10.163182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a3fc5-fef3-43c2-9c34-81126581a80d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:10.167504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a3fc5-fef3-43c2-9c34-81126581a80d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:10.212451 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1279/2577] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:10 2022] POST /identity/v3/projects => generated 403 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:10.217029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af621c-ab1a-457a-b499-f2cf46d90adb admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:10.231619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15af621c-ab1a-457a-b499-f2cf46d90adb admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:10.346664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985167-fac2-4002-9caa-e00ffb9d8cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:10.348073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985167-fac2-4002-9caa-e00ffb9d8cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:10.348454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985167-fac2-4002-9caa-e00ffb9d8cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:10.348861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86985167-fac2-4002-9caa-e00ffb9d8cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:10.350101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86985167-fac2-4002-9caa-e00ffb9d8cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:10.354523 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86985167-fac2-4002-9caa-e00ffb9d8cd5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:10.402721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1299/2578] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:10 2022] POST /identity/v3/users => generated 302 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:10.406139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3fc5-fef3-43c2-9c34-81126581a80d admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:10.419645 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:10.426097 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a3fc5-fef3-43c2-9c34-81126581a80d admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:10.441065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632db258-3582-4263-a01d-1aa323ab7f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:10.442053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632db258-3582-4263-a01d-1aa323ab7f38 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:10.442441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632db258-3582-4263-a01d-1aa323ab7f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:10.445013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632db258-3582-4263-a01d-1aa323ab7f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:10.445782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632db258-3582-4263-a01d-1aa323ab7f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:10.448005 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632db258-3582-4263-a01d-1aa323ab7f38 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:10.462551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1280/2579] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:10.466730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985167-fac2-4002-9caa-e00ffb9d8cd5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:10.481480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86985167-fac2-4002-9caa-e00ffb9d8cd5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:10.488026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ee9c50-7b96-4426-b95b-4e21c55732d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:10.488879 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee9c50-7b96-4426-b95b-4e21c55732d3 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:10.489086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee9c50-7b96-4426-b95b-4e21c55732d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:10.489796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ee9c50-7b96-4426-b95b-4e21c55732d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:10.490510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee9c50-7b96-4426-b95b-4e21c55732d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:10.492993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ee9c50-7b96-4426-b95b-4e21c55732d3 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:10.510435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1300/2580] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:10.514411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632db258-3582-4263-a01d-1aa323ab7f38 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:10.527440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632db258-3582-4263-a01d-1aa323ab7f38 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:10.536908 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e15f3-b6c2-4cd1-82d9-f879a2a57743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:10.538473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e15f3-b6c2-4cd1-82d9-f879a2a57743 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:10.539685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e15f3-b6c2-4cd1-82d9-f879a2a57743 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:10.539998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e15f3-b6c2-4cd1-82d9-f879a2a57743 admin admin] PATH_INFO: `/v3/projects/75b6493ebf584f448558b315579ece71/users/2aa855e07e2f408eb3de512473dd2e37/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:10.561686 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e15f3-b6c2-4cd1-82d9-f879a2a57743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75b6493ebf584f448558b315579ece71, user_id=2aa855e07e2f408eb3de512473dd2e37, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:10.564942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8e15f3-b6c2-4cd1-82d9-f879a2a57743 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:10.597968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1281/2581] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:10 2022] PUT /identity/v3/projects/75b6493ebf584f448558b315579ece71/users/2aa855e07e2f408eb3de512473dd2e37/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:10.604500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384216-de08-4322-b24d-91194b81ed25 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:10.605277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384216-de08-4322-b24d-91194b81ed25 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:10.605681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a384216-de08-4322-b24d-91194b81ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:10.638465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-5a384216-de08-4322-b24d-91194b81ed25 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:10.640549 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5a384216-de08-4322-b24d-91194b81ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:10.767227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1301/2582] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:10.777797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e15f3-b6c2-4cd1-82d9-f879a2a57743 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:10.779753 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8d8e15f3-b6c2-4cd1-82d9-f879a2a57743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:10.859752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8e15f3-b6c2-4cd1-82d9-f879a2a57743 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:10.890381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eabff3-78e5-4b45-992e-38c3261403f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:10.892647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eabff3-78e5-4b45-992e-38c3261403f5 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:10.892647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eabff3-78e5-4b45-992e-38c3261403f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:10.892911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eabff3-78e5-4b45-992e-38c3261403f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:10.910336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eabff3-78e5-4b45-992e-38c3261403f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:10.914411 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eabff3-78e5-4b45-992e-38c3261403f5 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:10.928146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1282/2583] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:12.021938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f0c7-be6b-42fb-b335-b3af00d52b14 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:12.023047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f0c7-be6b-42fb-b335-b3af00d52b14 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:12.024074 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e5f0c7-be6b-42fb-b335-b3af00d52b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:12.099811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-24e5f0c7-be6b-42fb-b335-b3af00d52b14 None None] MFA Rules not processed for user `2aa855e07e2f408eb3de512473dd2e37`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:12.101173 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-24e5f0c7-be6b-42fb-b335-b3af00d52b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:12.203615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:12.248345 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1302/2584] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:12.252163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eabff3-78e5-4b45-992e-38c3261403f5 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:12.273545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eabff3-78e5-4b45-992e-38c3261403f5 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:12.282818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b972a-b814-4cbf-98d9-26d93648573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:12.283669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b972a-b814-4cbf-98d9-26d93648573a admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:12.285237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b972a-b814-4cbf-98d9-26d93648573a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:12.285237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105b972a-b814-4cbf-98d9-26d93648573a admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:12.285885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b972a-b814-4cbf-98d9-26d93648573a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:12.288499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105b972a-b814-4cbf-98d9-26d93648573a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:12.332762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1283/2585] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:12 2022] POST /identity/v3/projects => generated 405 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:12.336738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5f0c7-be6b-42fb-b335-b3af00d52b14 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:12.355657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e5f0c7-be6b-42fb-b335-b3af00d52b14 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:12.569786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df687fd-cbf2-4544-b743-4b7ed85070b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:12.570405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df687fd-cbf2-4544-b743-4b7ed85070b0 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:12.570723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df687fd-cbf2-4544-b743-4b7ed85070b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:12.571031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df687fd-cbf2-4544-b743-4b7ed85070b0 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:12.571684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df687fd-cbf2-4544-b743-4b7ed85070b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:12.574164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df687fd-cbf2-4544-b743-4b7ed85070b0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:12.615923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1303/2586] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:12 2022] POST /identity/v3/users => generated 309 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:12.617541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b972a-b814-4cbf-98d9-26d93648573a admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:12.630609 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105b972a-b814-4cbf-98d9-26d93648573a admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:12.638249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f1682-8b52-495e-b975-d89ceffe742a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:12.638613 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f1682-8b52-495e-b975-d89ceffe742a admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:12.639139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f1682-8b52-495e-b975-d89ceffe742a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:12.639139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64f1682-8b52-495e-b975-d89ceffe742a admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:12.639796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f1682-8b52-495e-b975-d89ceffe742a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:12.645266 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64f1682-8b52-495e-b975-d89ceffe742a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:12.668431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1284/2587] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:12.672829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df687fd-cbf2-4544-b743-4b7ed85070b0 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:12.685275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df687fd-cbf2-4544-b743-4b7ed85070b0 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:12.690463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f26b7-bc01-44b3-a36d-87c04c9a4c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:12.691127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f26b7-bc01-44b3-a36d-87c04c9a4c4f admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:12.691400 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f26b7-bc01-44b3-a36d-87c04c9a4c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:12.691670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4f26b7-bc01-44b3-a36d-87c04c9a4c4f admin admin] PATH_INFO: `/v3/projects/4bb47b0bc5ba47188f72ba1432c68dd4/users/39ef30b371764a8182d52aab9d22fb50/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:12.716139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f26b7-bc01-44b3-a36d-87c04c9a4c4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb47b0bc5ba47188f72ba1432c68dd4, user_id=39ef30b371764a8182d52aab9d22fb50, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:12.728081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4f26b7-bc01-44b3-a36d-87c04c9a4c4f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:12.759489 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1304/2588] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:12 2022] PUT /identity/v3/projects/4bb47b0bc5ba47188f72ba1432c68dd4/users/39ef30b371764a8182d52aab9d22fb50/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:12.763883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f1682-8b52-495e-b975-d89ceffe742a admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:12.775874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64f1682-8b52-495e-b975-d89ceffe742a admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:12.868832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c936cfb-47ad-4e62-9f74-3617cc39dd62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:12.869653 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c936cfb-47ad-4e62-9f74-3617cc39dd62 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:12.870204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c936cfb-47ad-4e62-9f74-3617cc39dd62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:12.870854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c936cfb-47ad-4e62-9f74-3617cc39dd62 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:12.871851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c936cfb-47ad-4e62-9f74-3617cc39dd62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:12.873638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c936cfb-47ad-4e62-9f74-3617cc39dd62 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:12.886910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1285/2589] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:12 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:12.891251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f26b7-bc01-44b3-a36d-87c04c9a4c4f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:12.903297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4f26b7-bc01-44b3-a36d-87c04c9a4c4f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:12.909354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedfe25-0b87-4009-84c9-2b17f2803254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:12.910101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedfe25-0b87-4009-84c9-2b17f2803254 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:12.910448 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedfe25-0b87-4009-84c9-2b17f2803254 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:12.910798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccedfe25-0b87-4009-84c9-2b17f2803254 admin admin] PATH_INFO: `/v3/projects/4bb47b0bc5ba47188f72ba1432c68dd4/users/39ef30b371764a8182d52aab9d22fb50/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:12.913152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedfe25-0b87-4009-84c9-2b17f2803254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bb47b0bc5ba47188f72ba1432c68dd4, user_id=39ef30b371764a8182d52aab9d22fb50, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:12.916194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccedfe25-0b87-4009-84c9-2b17f2803254 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:12.937110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1305/2590] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:12 2022] PUT /identity/v3/projects/4bb47b0bc5ba47188f72ba1432c68dd4/users/39ef30b371764a8182d52aab9d22fb50/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:13.801040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf8db6-0c70-4b93-9151-5695d11d48db None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:13.801593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf8db6-0c70-4b93-9151-5695d11d48db None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:13.801798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf8db6-0c70-4b93-9151-5695d11d48db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:13.833319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0ccf8db6-0c70-4b93-9151-5695d11d48db None None] MFA Rules not processed for user `39ef30b371764a8182d52aab9d22fb50`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:13.834789 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0ccf8db6-0c70-4b93-9151-5695d11d48db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:13.880324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:13.961194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1286/2591] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:13 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:16.240884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedfe25-0b87-4009-84c9-2b17f2803254 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:16.330318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccedfe25-0b87-4009-84c9-2b17f2803254 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:16.345328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:16.346148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:16.346502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:16.346777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] PATH_INFO: `/v3/users/2aa855e07e2f408eb3de512473dd2e37` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:16.348659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aa855e07e2f408eb3de512473dd2e37)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:16.350818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:16.409472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a963-a5b6-487c-b78d-4a002ccdafe2 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:16.410028 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:16.410147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a963-a5b6-487c-b78d-4a002ccdafe2 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:16.410147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc9a963-a5b6-487c-b78d-4a002ccdafe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:16.411895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aa855e07e2f408eb3de512473dd2e37'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:16.423339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aa855e07e2f408eb3de512473dd2e37'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:16.424417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aa855e07e2f408eb3de512473dd2e37'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:16.432659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aa855e07e2f408eb3de512473dd2e37'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:16.440923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9bc9a963-a5b6-487c-b78d-4a002ccdafe2 None None] MFA Rules not processed for user `3d15eaa485b947cc828fd5058ceab012`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:16.442170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9bc9a963-a5b6-487c-b78d-4a002ccdafe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:16.445007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aa855e07e2f408eb3de512473dd2e37'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:16.451399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1306/2592] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:16 2022] DELETE /identity/v3/users/2aa855e07e2f408eb3de512473dd2e37 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:16.519988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1287/2593] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:16 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:16.537726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:16.539315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:16.622211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa9643c-189d-4cff-baab-311693610648 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:16.627938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:16.628693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:16.629068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:16.629460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:16.631291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:16.699819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:16.701447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:16.712613 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1307/2594] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:16.791381 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a963-a5b6-487c-b78d-4a002ccdafe2 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:16.792914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9bc9a963-a5b6-487c-b78d-4a002ccdafe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:16.806787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc9a963-a5b6-487c-b78d-4a002ccdafe2 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:16.909162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:16.910143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:16.910631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:16.913816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] PATH_INFO: `/v3/projects/75b6493ebf584f448558b315579ece71` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:16.915384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75b6493ebf584f448558b315579ece71)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:16.918602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:16.992372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:17.001984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75b6493ebf584f448558b315579ece71', 'request_id': 'req-d20d4ec0-3be6-4562-9805-f94b45255321'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.010984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:17.012656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:17.031261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75b6493ebf584f448558b315579ece71', 'request_id': 'req-d20d4ec0-3be6-4562-9805-f94b45255321'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.044813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75b6493ebf584f448558b315579ece71', 'request_id': 'req-d20d4ec0-3be6-4562-9805-f94b45255321'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.074773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] The token cache is being invalidate because project 75b6493ebf584f448558b315579ece71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:17.075183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.076291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.078549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1288/2595] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:16 2022] DELETE /identity/v3/projects/75b6493ebf584f448558b315579ece71 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:17.083785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:17.086705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:17.156395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:17.164254 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e41b3d-3302-472c-8514-c37e2a692d1b service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:17.201061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20d4ec0-3be6-4562-9805-f94b45255321 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:17.207444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:17.208548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:17.209504 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:17.209969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] PATH_INFO: `/v3/users/39ef30b371764a8182d52aab9d22fb50` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:17.211748 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=39ef30b371764a8182d52aab9d22fb50)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:17.214106 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:17.242773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04f2c-ebf3-4dce-903b-4630ff3edde9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:17.243491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04f2c-ebf3-4dce-903b-4630ff3edde9 service placement] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:17.243784 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04f2c-ebf3-4dce-903b-4630ff3edde9 service placement] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:17.244742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef04f2c-ebf3-4dce-903b-4630ff3edde9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:17.249299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-eef04f2c-ebf3-4dce-903b-4630ff3edde9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:17.287552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef04f2c-ebf3-4dce-903b-4630ff3edde9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:17.289380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef04f2c-ebf3-4dce-903b-4630ff3edde9 service placement] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:17.294431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39ef30b371764a8182d52aab9d22fb50'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.311027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1308/2596] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:55:17.317795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39ef30b371764a8182d52aab9d22fb50'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.336185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39ef30b371764a8182d52aab9d22fb50'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.363283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39ef30b371764a8182d52aab9d22fb50'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.374961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-6f2570bd-ee3a-4a1f-9f88-b2ec8e0bce4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39ef30b371764a8182d52aab9d22fb50'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.388974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1289/2597] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:17 2022] DELETE /identity/v3/users/39ef30b371764a8182d52aab9d22fb50 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:17.647732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04f2c-ebf3-4dce-903b-4630ff3edde9 service placement] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:17.660774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef04f2c-ebf3-4dce-903b-4630ff3edde9 service placement] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:17.752161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:17.753496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:17.753948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:17.754372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] PATH_INFO: `/v3/projects/4bb47b0bc5ba47188f72ba1432c68dd4` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:17.756121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bb47b0bc5ba47188f72ba1432c68dd4)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:17.758551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:17.813857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bb47b0bc5ba47188f72ba1432c68dd4', 'request_id': 'req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.824561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bb47b0bc5ba47188f72ba1432c68dd4', 'request_id': 'req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.831823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bb47b0bc5ba47188f72ba1432c68dd4', 'request_id': 'req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.845900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] The token cache is being invalidate because project 4bb47b0bc5ba47188f72ba1432c68dd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:17.846109 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.846747 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-aa2c76eb-7e5d-469b-840a-74eec8a83cbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:17.848447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1309/2598] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:17 2022] DELETE /identity/v3/projects/4bb47b0bc5ba47188f72ba1432c68dd4 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:17.854324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56237517-3ad5-4b7c-bff5-f80985ff8dfb None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:17.854840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56237517-3ad5-4b7c-bff5-f80985ff8dfb None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:17.855012 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56237517-3ad5-4b7c-bff5-f80985ff8dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:17.878822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-56237517-3ad5-4b7c-bff5-f80985ff8dfb None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:17.880136 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-56237517-3ad5-4b7c-bff5-f80985ff8dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:17.964453 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:17.987142 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1290/2599] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:17.994626 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34f569-a407-4cd9-8534-ff388bdbdf02 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:17.995004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34f569-a407-4cd9-8534-ff388bdbdf02 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:17.995353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34f569-a407-4cd9-8534-ff388bdbdf02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.017550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7b34f569-a407-4cd9-8534-ff388bdbdf02 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:18.019085 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7b34f569-a407-4cd9-8534-ff388bdbdf02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:18.032961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1310/2600] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:18.033260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56237517-3ad5-4b7c-bff5-f80985ff8dfb None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.048406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56237517-3ad5-4b7c-bff5-f80985ff8dfb None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.056910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90724e-b0e5-489a-996b-087cc862a0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.058161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90724e-b0e5-489a-996b-087cc862a0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.058674 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90724e-b0e5-489a-996b-087cc862a0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.059249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90724e-b0e5-489a-996b-087cc862a0d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.060372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90724e-b0e5-489a-996b-087cc862a0d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:18.061038 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90724e-b0e5-489a-996b-087cc862a0d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.063506 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90724e-b0e5-489a-996b-087cc862a0d2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:18.083614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34f569-a407-4cd9-8534-ff388bdbdf02 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.091121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1291/2601] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:18.096038 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34f569-a407-4cd9-8534-ff388bdbdf02 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.101679 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc08c6-d191-4069-a4cf-14e4427663b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.102483 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc08c6-d191-4069-a4cf-14e4427663b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.103072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc08c6-d191-4069-a4cf-14e4427663b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.103527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc08c6-d191-4069-a4cf-14e4427663b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.104287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc08c6-d191-4069-a4cf-14e4427663b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.106464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc08c6-d191-4069-a4cf-14e4427663b6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:18.125561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:18.152492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90724e-b0e5-489a-996b-087cc862a0d2 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.163555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1311/2602] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:18 2022] POST /identity/v3/projects => generated 365 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:18.164802 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90724e-b0e5-489a-996b-087cc862a0d2 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.236657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408db87-3d2c-4f23-9e54-23a60c3fd9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.237535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408db87-3d2c-4f23-9e54-23a60c3fd9be admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.237922 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408db87-3d2c-4f23-9e54-23a60c3fd9be admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.238931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408db87-3d2c-4f23-9e54-23a60c3fd9be admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.238931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408db87-3d2c-4f23-9e54-23a60c3fd9be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.241320 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408db87-3d2c-4f23-9e54-23a60c3fd9be admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:18.276872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc08c6-d191-4069-a4cf-14e4427663b6 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.284556 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1292/2603] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:18 2022] POST /identity/v3/users => generated 283 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:18.290416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc08c6-d191-4069-a4cf-14e4427663b6 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.298576 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3032d4-9213-45f2-96ff-bdbebbb6b77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.299730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3032d4-9213-45f2-96ff-bdbebbb6b77d admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.300295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3032d4-9213-45f2-96ff-bdbebbb6b77d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.300792 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3032d4-9213-45f2-96ff-bdbebbb6b77d admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.301881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3032d4-9213-45f2-96ff-bdbebbb6b77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.304177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3032d4-9213-45f2-96ff-bdbebbb6b77d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:18.322426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408db87-3d2c-4f23-9e54-23a60c3fd9be admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.325672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1312/2604] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:18.342873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408db87-3d2c-4f23-9e54-23a60c3fd9be admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.344148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2a4f-8852-4de2-a645-1384e2936bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.344301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b12411-d98f-49c5-97ed-ce3cc7e890a9 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.344484 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b12411-d98f-49c5-97ed-ce3cc7e890a9 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.344759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b12411-d98f-49c5-97ed-ce3cc7e890a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.345340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2a4f-8852-4de2-a645-1384e2936bd9 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.345775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2a4f-8852-4de2-a645-1384e2936bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.346196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b2a4f-8852-4de2-a645-1384e2936bd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.346902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b2a4f-8852-4de2-a645-1384e2936bd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.349755 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1b2a4f-8852-4de2-a645-1384e2936bd9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:18.360893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1293/2605] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:18.365427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2a4f-8852-4de2-a645-1384e2936bd9 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.377198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b2a4f-8852-4de2-a645-1384e2936bd9 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.381095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-44b12411-d98f-49c5-97ed-ce3cc7e890a9 None None] MFA Rules not processed for user `b16db8c9b37f40faa002f48ddcc69847`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:18.381995 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c72e7d-924d-4160-afec-03d1d0d843b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.382765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c72e7d-924d-4160-afec-03d1d0d843b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.383151 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c72e7d-924d-4160-afec-03d1d0d843b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.383555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c72e7d-924d-4160-afec-03d1d0d843b3 admin admin] PATH_INFO: `/v3/projects/f5f468e2cc82490ab954ac3e381a5ffc/users/304bf4e6e47b4f3580cb5fb0794a9934/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.384356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-44b12411-d98f-49c5-97ed-ce3cc7e890a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:18.402233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c72e7d-924d-4160-afec-03d1d0d843b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f468e2cc82490ab954ac3e381a5ffc, user_id=304bf4e6e47b4f3580cb5fb0794a9934, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.405422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c72e7d-924d-4160-afec-03d1d0d843b3 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:18.437108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1294/2606] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:18 2022] PUT /identity/v3/projects/f5f468e2cc82490ab954ac3e381a5ffc/users/304bf4e6e47b4f3580cb5fb0794a9934/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:18.448052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de546955-b620-48ab-9934-68e910fec29b None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.448333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de546955-b620-48ab-9934-68e910fec29b None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.448620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de546955-b620-48ab-9934-68e910fec29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.482379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-de546955-b620-48ab-9934-68e910fec29b None None] MFA Rules not processed for user `304bf4e6e47b4f3580cb5fb0794a9934`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:18.483678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-de546955-b620-48ab-9934-68e910fec29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:18.484295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1313/2607] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:18.597680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1295/2608] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:18.600936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b12411-d98f-49c5-97ed-ce3cc7e890a9 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.613263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b12411-d98f-49c5-97ed-ce3cc7e890a9 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.685881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16bae9-4392-4ab5-b9fd-b208d16b4caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.686510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16bae9-4392-4ab5-b9fd-b208d16b4caa admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.686796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16bae9-4392-4ab5-b9fd-b208d16b4caa admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.687073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c16bae9-4392-4ab5-b9fd-b208d16b4caa admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.687718 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16bae9-4392-4ab5-b9fd-b208d16b4caa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.690119 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c16bae9-4392-4ab5-b9fd-b208d16b4caa admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:18.731701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1314/2609] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:18 2022] POST /identity/v3/projects => generated 363 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:18.735957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de546955-b620-48ab-9934-68e910fec29b None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.753678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de546955-b620-48ab-9934-68e910fec29b None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.814759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:18.866503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac83bc-a5e6-418b-9d7a-df37860f9ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.867867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac83bc-a5e6-418b-9d7a-df37860f9ffa admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.868213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac83bc-a5e6-418b-9d7a-df37860f9ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.868581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ac83bc-a5e6-418b-9d7a-df37860f9ffa admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.869342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac83bc-a5e6-418b-9d7a-df37860f9ffa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.871480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ac83bc-a5e6-418b-9d7a-df37860f9ffa admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:18.894572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1296/2610] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:18 2022] POST /identity/v3/users => generated 288 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:18.898442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16bae9-4392-4ab5-b9fd-b208d16b4caa admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.910653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c16bae9-4392-4ab5-b9fd-b208d16b4caa admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.916288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504da4-5f76-460c-98dd-cab3181b2fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.917057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504da4-5f76-460c-98dd-cab3181b2fef admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.917347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504da4-5f76-460c-98dd-cab3181b2fef admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.917657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2504da4-5f76-460c-98dd-cab3181b2fef admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.918314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504da4-5f76-460c-98dd-cab3181b2fef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.919909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2504da4-5f76-460c-98dd-cab3181b2fef admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:18.931890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1315/2611] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:18.936313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac83bc-a5e6-418b-9d7a-df37860f9ffa admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:18.948124 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ac83bc-a5e6-418b-9d7a-df37860f9ffa admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:18.953784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcdbf7-d4aa-486b-bef7-dc8aa23a2c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:18.954615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcdbf7-d4aa-486b-bef7-dc8aa23a2c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:18.954896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcdbf7-d4aa-486b-bef7-dc8aa23a2c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:18.955177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bcdbf7-d4aa-486b-bef7-dc8aa23a2c7d admin admin] PATH_INFO: `/v3/projects/f15d3ffdff8d4c869c217176c2fc729a/users/1b55d37593ec4e4ea7dd923f455da28e/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:18.976120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcdbf7-d4aa-486b-bef7-dc8aa23a2c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15d3ffdff8d4c869c217176c2fc729a, user_id=1b55d37593ec4e4ea7dd923f455da28e, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:18.979330 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bcdbf7-d4aa-486b-bef7-dc8aa23a2c7d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:19.000820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1297/2612] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:18 2022] PUT /identity/v3/projects/f15d3ffdff8d4c869c217176c2fc729a/users/1b55d37593ec4e4ea7dd923f455da28e/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:19.005349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504da4-5f76-460c-98dd-cab3181b2fef admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:19.018461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2504da4-5f76-460c-98dd-cab3181b2fef admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:19.090227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dbe4f4-2a70-491e-abde-d28aa9a33f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:19.093697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbe4f4-2a70-491e-abde-d28aa9a33f18 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:19.093697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbe4f4-2a70-491e-abde-d28aa9a33f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:19.093697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dbe4f4-2a70-491e-abde-d28aa9a33f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:19.093697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbe4f4-2a70-491e-abde-d28aa9a33f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:19.094663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dbe4f4-2a70-491e-abde-d28aa9a33f18 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:19.097709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:19.109553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1316/2613] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:19 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:19.111759 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcdbf7-d4aa-486b-bef7-dc8aa23a2c7d admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:19.124135 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bcdbf7-d4aa-486b-bef7-dc8aa23a2c7d admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:19.129054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3c8f7-82c7-4fd4-9c7a-1887f107213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:19.129835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3c8f7-82c7-4fd4-9c7a-1887f107213c admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:19.130186 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3c8f7-82c7-4fd4-9c7a-1887f107213c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:19.130534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e3c8f7-82c7-4fd4-9c7a-1887f107213c admin admin] PATH_INFO: `/v3/projects/f15d3ffdff8d4c869c217176c2fc729a/users/1b55d37593ec4e4ea7dd923f455da28e/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:19.132622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3c8f7-82c7-4fd4-9c7a-1887f107213c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f15d3ffdff8d4c869c217176c2fc729a, user_id=1b55d37593ec4e4ea7dd923f455da28e, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:19.136315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e3c8f7-82c7-4fd4-9c7a-1887f107213c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:19.148423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1298/2614] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:19 2022] PUT /identity/v3/projects/f15d3ffdff8d4c869c217176c2fc729a/users/1b55d37593ec4e4ea7dd923f455da28e/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:19.160539 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aff5e-3575-43a1-8e7f-4350c399c478 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:19.160827 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aff5e-3575-43a1-8e7f-4350c399c478 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:19.161104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4aff5e-3575-43a1-8e7f-4350c399c478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:19.191498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-eb4aff5e-3575-43a1-8e7f-4350c399c478 None None] MFA Rules not processed for user `1b55d37593ec4e4ea7dd923f455da28e`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:19.192731 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-eb4aff5e-3575-43a1-8e7f-4350c399c478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:19.269479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1317/2615] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:19.281795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3c8f7-82c7-4fd4-9c7a-1887f107213c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:19.283642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-98e3c8f7-82c7-4fd4-9c7a-1887f107213c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:19.363964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e3c8f7-82c7-4fd4-9c7a-1887f107213c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:19.367989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c498bd-83cb-4f6d-83d9-a2a487e5c349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:19.369031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c498bd-83cb-4f6d-83d9-a2a487e5c349 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:19.369328 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c498bd-83cb-4f6d-83d9-a2a487e5c349 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:19.369791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c498bd-83cb-4f6d-83d9-a2a487e5c349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:19.381317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c498bd-83cb-4f6d-83d9-a2a487e5c349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:19.382867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c498bd-83cb-4f6d-83d9-a2a487e5c349 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:19.393982 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1299/2616] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:19.938899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aff5e-3575-43a1-8e7f-4350c399c478 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:20.026787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4aff5e-3575-43a1-8e7f-4350c399c478 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:20.031499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:20.032203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:20.032556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:20.032909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] PATH_INFO: `/v3/users/304bf4e6e47b4f3580cb5fb0794a9934` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:20.034243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] RBAC: Authorizing `identity:delete_user(user_id=304bf4e6e47b4f3580cb5fb0794a9934)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:20.036387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:20.109031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304bf4e6e47b4f3580cb5fb0794a9934'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.135998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304bf4e6e47b4f3580cb5fb0794a9934'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.135998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304bf4e6e47b4f3580cb5fb0794a9934'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.146435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304bf4e6e47b4f3580cb5fb0794a9934'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.170346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304bf4e6e47b4f3580cb5fb0794a9934'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.178064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1318/2617] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:19 2022] DELETE /identity/v3/users/304bf4e6e47b4f3580cb5fb0794a9934 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:20.183029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5ce94-8cb4-46d7-b223-59dac7898885 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:20.183530 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5ce94-8cb4-46d7-b223-59dac7898885 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:20.183623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5ce94-8cb4-46d7-b223-59dac7898885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:20.205487 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e9a5ce94-8cb4-46d7-b223-59dac7898885 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:20.215261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e9a5ce94-8cb4-46d7-b223-59dac7898885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:20.278885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1300/2618] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:20.288631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:20.290057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:20.296120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:20.369260 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9936422-dc43-45c4-a167-5b227d95492b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:20.372851 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb54dde-77f4-48d3-927e-942d284cdc72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:20.373496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb54dde-77f4-48d3-927e-942d284cdc72 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:20.373771 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb54dde-77f4-48d3-927e-942d284cdc72 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:20.374069 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb54dde-77f4-48d3-927e-942d284cdc72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:20.383065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb54dde-77f4-48d3-927e-942d284cdc72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:20.385089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb54dde-77f4-48d3-927e-942d284cdc72 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:20.394661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1319/2619] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:20.670650 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5ce94-8cb4-46d7-b223-59dac7898885 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:20.672120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e9a5ce94-8cb4-46d7-b223-59dac7898885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:20.684790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a5ce94-8cb4-46d7-b223-59dac7898885 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:20.689493 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:20.690131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:20.690520 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:20.690723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] PATH_INFO: `/v3/projects/f5f468e2cc82490ab954ac3e381a5ffc` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:20.691845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f468e2cc82490ab954ac3e381a5ffc)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:20.693802 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:20.713335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:20.748194 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f468e2cc82490ab954ac3e381a5ffc', 'request_id': 'req-012376cc-330a-444d-b557-989da48a95d5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.756478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f468e2cc82490ab954ac3e381a5ffc', 'request_id': 'req-012376cc-330a-444d-b557-989da48a95d5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.763623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f468e2cc82490ab954ac3e381a5ffc', 'request_id': 'req-012376cc-330a-444d-b557-989da48a95d5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.774683 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] The token cache is being invalidate because project f5f468e2cc82490ab954ac3e381a5ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:20.775022 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.775634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.777242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1301/2620] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:20 2022] DELETE /identity/v3/projects/f5f468e2cc82490ab954ac3e381a5ffc => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:20.781086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb54dde-77f4-48d3-927e-942d284cdc72 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:20.790594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb54dde-77f4-48d3-927e-942d284cdc72 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:20.852503 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:20.853193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:20.853516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:20.853798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] PATH_INFO: `/v3/users/1b55d37593ec4e4ea7dd923f455da28e` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:20.854935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b55d37593ec4e4ea7dd923f455da28e)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:20.856831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:20.904434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b55d37593ec4e4ea7dd923f455da28e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.911545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b55d37593ec4e4ea7dd923f455da28e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.912161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b55d37593ec4e4ea7dd923f455da28e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.919007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b55d37593ec4e4ea7dd923f455da28e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.930694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-3a4725e0-4385-4339-89af-d6e22ec08740 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b55d37593ec4e4ea7dd923f455da28e'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:20.936986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1320/2621] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:20 2022] DELETE /identity/v3/users/1b55d37593ec4e4ea7dd923f455da28e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:21.214095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:21.215524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:21.228981 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012376cc-330a-444d-b557-989da48a95d5 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:21.285782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:21.286418 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.286701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.286983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] PATH_INFO: `/v3/projects/f15d3ffdff8d4c869c217176c2fc729a` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.288089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f15d3ffdff8d4c869c217176c2fc729a)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:21.290070 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:21.342378 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f15d3ffdff8d4c869c217176c2fc729a', 'request_id': 'req-51d03e13-23f8-4d20-b3db-bdae61dc9e21'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:21.350788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f15d3ffdff8d4c869c217176c2fc729a', 'request_id': 'req-51d03e13-23f8-4d20-b3db-bdae61dc9e21'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:21.357877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f15d3ffdff8d4c869c217176c2fc729a', 'request_id': 'req-51d03e13-23f8-4d20-b3db-bdae61dc9e21'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:21.370405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] The token cache is being invalidate because project f15d3ffdff8d4c869c217176c2fc729a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:21.370698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:21.371360 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-51d03e13-23f8-4d20-b3db-bdae61dc9e21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:21.372847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1302/2622] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:21 2022] DELETE /identity/v3/projects/f15d3ffdff8d4c869c217176c2fc729a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:21.377681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124adb9-476b-49d6-9569-5afc2517fee4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.378152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124adb9-476b-49d6-9569-5afc2517fee4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.378258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124adb9-476b-49d6-9569-5afc2517fee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.397357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e124adb9-476b-49d6-9569-5afc2517fee4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:21.398569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e124adb9-476b-49d6-9569-5afc2517fee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:21.420111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:21.465137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1321/2623] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:21.472912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41bca4-f789-4e17-85b9-9e0c6f5c757d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.473235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41bca4-f789-4e17-85b9-9e0c6f5c757d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.473575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41bca4-f789-4e17-85b9-9e0c6f5c757d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.494199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-fa41bca4-f789-4e17-85b9-9e0c6f5c757d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:21.495387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-fa41bca4-f789-4e17-85b9-9e0c6f5c757d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:21.503458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1303/2624] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:21.507622 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124adb9-476b-49d6-9569-5afc2517fee4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:21.517010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124adb9-476b-49d6-9569-5afc2517fee4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:21.521575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3a386-876c-4267-a7d0-45f25fff7203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:21.522160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3a386-876c-4267-a7d0-45f25fff7203 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.522431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3a386-876c-4267-a7d0-45f25fff7203 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.522697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3a386-876c-4267-a7d0-45f25fff7203 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.523331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3a386-876c-4267-a7d0-45f25fff7203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:21.523629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3a386-876c-4267-a7d0-45f25fff7203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:21.525764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3a386-876c-4267-a7d0-45f25fff7203 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:21.537060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1322/2625] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 17 00:55:21.541658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41bca4-f789-4e17-85b9-9e0c6f5c757d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:21.550791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41bca4-f789-4e17-85b9-9e0c6f5c757d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:21.555724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f04cb8-73b4-4acf-9f15-a69fa7d471bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:21.556405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f04cb8-73b4-4acf-9f15-a69fa7d471bb admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.556716 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f04cb8-73b4-4acf-9f15-a69fa7d471bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.556991 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f04cb8-73b4-4acf-9f15-a69fa7d471bb admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.557655 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f04cb8-73b4-4acf-9f15-a69fa7d471bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:21.559582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f04cb8-73b4-4acf-9f15-a69fa7d471bb admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:21.588041 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1304/2626] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:21 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:21.592146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3a386-876c-4267-a7d0-45f25fff7203 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:21.602609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3a386-876c-4267-a7d0-45f25fff7203 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:21.659330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b4f8c-6dcc-422e-b030-f4c300e49812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:21.659935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b4f8c-6dcc-422e-b030-f4c300e49812 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.660212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b4f8c-6dcc-422e-b030-f4c300e49812 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.660481 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b4f8c-6dcc-422e-b030-f4c300e49812 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.661151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b4f8c-6dcc-422e-b030-f4c300e49812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:21.663129 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611b4f8c-6dcc-422e-b030-f4c300e49812 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:21.683881 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1323/2627] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:21 2022] POST /identity/v3/users => generated 279 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:21.687967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f04cb8-73b4-4acf-9f15-a69fa7d471bb admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:21.698354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f04cb8-73b4-4acf-9f15-a69fa7d471bb admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:21.702984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996192b-f846-4304-a823-1e0163051dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:21.703616 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996192b-f846-4304-a823-1e0163051dc1 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.703900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996192b-f846-4304-a823-1e0163051dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.704205 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996192b-f846-4304-a823-1e0163051dc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.704849 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996192b-f846-4304-a823-1e0163051dc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:21.706480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996192b-f846-4304-a823-1e0163051dc1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:21.707688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:21.719079 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1305/2628] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:21.722612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b4f8c-6dcc-422e-b030-f4c300e49812 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:21.733640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611b4f8c-6dcc-422e-b030-f4c300e49812 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:21.738541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8364de-c8fb-4074-b6ad-deac5b72e8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:21.739168 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8364de-c8fb-4074-b6ad-deac5b72e8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.739442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8364de-c8fb-4074-b6ad-deac5b72e8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.739712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8364de-c8fb-4074-b6ad-deac5b72e8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.740350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8364de-c8fb-4074-b6ad-deac5b72e8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:21.741949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8364de-c8fb-4074-b6ad-deac5b72e8f0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:21.752544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1324/2629] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:21.757053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996192b-f846-4304-a823-1e0163051dc1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:21.771774 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996192b-f846-4304-a823-1e0163051dc1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:21.777319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a0e57-c8ce-4a7a-9c1c-3ee25b145657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:21.778039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a0e57-c8ce-4a7a-9c1c-3ee25b145657 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.778322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a0e57-c8ce-4a7a-9c1c-3ee25b145657 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.778601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a0e57-c8ce-4a7a-9c1c-3ee25b145657 admin admin] PATH_INFO: `/v3/projects/96393268ee7547f49b4254e5e749c3c7/users/4041db0a865e4969b946dabd6b9d2680/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.795781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a0e57-c8ce-4a7a-9c1c-3ee25b145657 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96393268ee7547f49b4254e5e749c3c7, user_id=4041db0a865e4969b946dabd6b9d2680, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:21.798558 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a0e57-c8ce-4a7a-9c1c-3ee25b145657 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:21.812827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1306/2630] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:21 2022] PUT /identity/v3/projects/96393268ee7547f49b4254e5e749c3c7/users/4041db0a865e4969b946dabd6b9d2680/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:21.823775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073fb65-3b6e-4104-9d6d-9b860e3edd29 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:21.824062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073fb65-3b6e-4104-9d6d-9b860e3edd29 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:21.824379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c073fb65-3b6e-4104-9d6d-9b860e3edd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:21.856139 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-c073fb65-3b6e-4104-9d6d-9b860e3edd29 None None] MFA Rules not processed for user `4041db0a865e4969b946dabd6b9d2680`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:21.857391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c073fb65-3b6e-4104-9d6d-9b860e3edd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:21.938398 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1325/2631] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:21.942934 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a0e57-c8ce-4a7a-9c1c-3ee25b145657 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:22.007489 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a0e57-c8ce-4a7a-9c1c-3ee25b145657 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:22.012213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237f9b-c426-4f3f-a7d9-17a69f18eecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:22.012818 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237f9b-c426-4f3f-a7d9-17a69f18eecd admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:22.013095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237f9b-c426-4f3f-a7d9-17a69f18eecd admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:22.013367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09237f9b-c426-4f3f-a7d9-17a69f18eecd admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:22.014020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09237f9b-c426-4f3f-a7d9-17a69f18eecd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:22.015935 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09237f9b-c426-4f3f-a7d9-17a69f18eecd admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:22.045147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1307/2632] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:21 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:22.046455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073fb65-3b6e-4104-9d6d-9b860e3edd29 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:22.060026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c073fb65-3b6e-4104-9d6d-9b860e3edd29 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:22.076286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:22.118504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a25d86-aa77-4eb1-8676-2ac9750662b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:22.119928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a25d86-aa77-4eb1-8676-2ac9750662b3 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:22.120205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a25d86-aa77-4eb1-8676-2ac9750662b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:22.120507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a25d86-aa77-4eb1-8676-2ac9750662b3 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:22.121136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a25d86-aa77-4eb1-8676-2ac9750662b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:22.123073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a25d86-aa77-4eb1-8676-2ac9750662b3 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:22.144294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1326/2633] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:22 2022] POST /identity/v3/users => generated 285 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:22.148422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237f9b-c426-4f3f-a7d9-17a69f18eecd admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:22.158731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09237f9b-c426-4f3f-a7d9-17a69f18eecd admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:22.163373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be066f8-4ff8-44cd-88fe-2a25ec544455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:22.163968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be066f8-4ff8-44cd-88fe-2a25ec544455 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:22.164248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be066f8-4ff8-44cd-88fe-2a25ec544455 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:22.164524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be066f8-4ff8-44cd-88fe-2a25ec544455 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:22.165159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be066f8-4ff8-44cd-88fe-2a25ec544455 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:22.167367 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be066f8-4ff8-44cd-88fe-2a25ec544455 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:22.178492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1308/2634] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:22.183173 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a25d86-aa77-4eb1-8676-2ac9750662b3 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:22.194801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a25d86-aa77-4eb1-8676-2ac9750662b3 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:22.200766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08631-ad20-4adc-932b-835e64625fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:22.201841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08631-ad20-4adc-932b-835e64625fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:22.202222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08631-ad20-4adc-932b-835e64625fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:22.202513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f08631-ad20-4adc-932b-835e64625fa6 admin admin] PATH_INFO: `/v3/projects/dd1d870d4ace466ea90707ebad697f0d/users/d5b4a8f8540b450fbf5258b3f040c079/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:22.229192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08631-ad20-4adc-932b-835e64625fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1d870d4ace466ea90707ebad697f0d, user_id=d5b4a8f8540b450fbf5258b3f040c079, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:22.231895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f08631-ad20-4adc-932b-835e64625fa6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:22.245257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1327/2635] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:22 2022] PUT /identity/v3/projects/dd1d870d4ace466ea90707ebad697f0d/users/d5b4a8f8540b450fbf5258b3f040c079/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:22.249317 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be066f8-4ff8-44cd-88fe-2a25ec544455 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:22.259398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be066f8-4ff8-44cd-88fe-2a25ec544455 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:22.314021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ec8c7-dd68-4f36-a2eb-5c95638cb6b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:22.314622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ec8c7-dd68-4f36-a2eb-5c95638cb6b3 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:22.314896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ec8c7-dd68-4f36-a2eb-5c95638cb6b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:22.315166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ec8c7-dd68-4f36-a2eb-5c95638cb6b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:22.315794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ec8c7-dd68-4f36-a2eb-5c95638cb6b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:22.317370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ec8c7-dd68-4f36-a2eb-5c95638cb6b3 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:22.327016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1309/2636] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:22.331152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08631-ad20-4adc-932b-835e64625fa6 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:22.342268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f08631-ad20-4adc-932b-835e64625fa6 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:22.346854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7679407-ba11-43d0-996b-b33fdf2b5168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:22.347495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7679407-ba11-43d0-996b-b33fdf2b5168 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:22.347776 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7679407-ba11-43d0-996b-b33fdf2b5168 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:22.348052 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7679407-ba11-43d0-996b-b33fdf2b5168 admin admin] PATH_INFO: `/v3/projects/dd1d870d4ace466ea90707ebad697f0d/users/d5b4a8f8540b450fbf5258b3f040c079/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:22.350009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7679407-ba11-43d0-996b-b33fdf2b5168 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1d870d4ace466ea90707ebad697f0d, user_id=d5b4a8f8540b450fbf5258b3f040c079, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:22.352619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7679407-ba11-43d0-996b-b33fdf2b5168 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:22.363363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1328/2637] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:22 2022] PUT /identity/v3/projects/dd1d870d4ace466ea90707ebad697f0d/users/d5b4a8f8540b450fbf5258b3f040c079/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:22.374527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83bd05-b8fb-49f3-831d-7c60ff999aa0 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:22.374814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83bd05-b8fb-49f3-831d-7c60ff999aa0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:22.375092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83bd05-b8fb-49f3-831d-7c60ff999aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:22.404919 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-bb83bd05-b8fb-49f3-831d-7c60ff999aa0 None None] MFA Rules not processed for user `d5b4a8f8540b450fbf5258b3f040c079`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:22.406212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bb83bd05-b8fb-49f3-831d-7c60ff999aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:22.437486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:22.476969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1310/2638] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:22 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:22.488709 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7679407-ba11-43d0-996b-b33fdf2b5168 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:22.490627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e7679407-ba11-43d0-996b-b33fdf2b5168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:22.547741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7679407-ba11-43d0-996b-b33fdf2b5168 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:22.551377 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2eb3a5-ce4b-4da7-bd09-e6da9ec6fa7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:22.551963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2eb3a5-ce4b-4da7-bd09-e6da9ec6fa7e service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:22.552247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2eb3a5-ce4b-4da7-bd09-e6da9ec6fa7e service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:22.552520 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2eb3a5-ce4b-4da7-bd09-e6da9ec6fa7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:22.561376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2eb3a5-ce4b-4da7-bd09-e6da9ec6fa7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:22.562819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2eb3a5-ce4b-4da7-bd09-e6da9ec6fa7e service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:22.572609 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1329/2639] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:22 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:22.651362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83bd05-b8fb-49f3-831d-7c60ff999aa0 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:22.660888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83bd05-b8fb-49f3-831d-7c60ff999aa0 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:22.664534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dcb75-5071-4668-99e6-3b961c43d2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:22.665130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcb75-5071-4668-99e6-3b961c43d2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:22.665428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcb75-5071-4668-99e6-3b961c43d2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:22.665711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dcb75-5071-4668-99e6-3b961c43d2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:22.720347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dcb75-5071-4668-99e6-3b961c43d2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:22.721809 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dcb75-5071-4668-99e6-3b961c43d2d9 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:22.730517 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1311/2640] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:22 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:26.970782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ebb6-0351-4fca-b591-fbce852695fe None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:26.971296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ebb6-0351-4fca-b591-fbce852695fe None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:26.971296 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd4ebb6-0351-4fca-b591-fbce852695fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:26.990804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-fbd4ebb6-0351-4fca-b591-fbce852695fe None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:26.992056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fbd4ebb6-0351-4fca-b591-fbce852695fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:27.047669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1330/2641] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:55:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:27.060247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dcb75-5071-4668-99e6-3b961c43d2d9 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:27.061766 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ef3dcb75-5071-4668-99e6-3b961c43d2d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:27.144516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dcb75-5071-4668-99e6-3b961c43d2d9 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:27.153970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a943-cde5-40fb-acc9-7424164cb171 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:27.154591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a943-cde5-40fb-acc9-7424164cb171 service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:27.154870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a943-cde5-40fb-acc9-7424164cb171 service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:27.155156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37a943-cde5-40fb-acc9-7424164cb171 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:27.164684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37a943-cde5-40fb-acc9-7424164cb171 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:27.166305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37a943-cde5-40fb-acc9-7424164cb171 service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:27.175231 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1312/2642] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:55:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:55:27.680551 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347edb3-3f1d-4775-b21c-b3944b66b77d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:27.680836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347edb3-3f1d-4775-b21c-b3944b66b77d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:27.681651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347edb3-3f1d-4775-b21c-b3944b66b77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:27.700694 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b347edb3-3f1d-4775-b21c-b3944b66b77d None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:27.701976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b347edb3-3f1d-4775-b21c-b3944b66b77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:27.708894 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1331/2643] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 17 00:55:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:27.721081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a943-cde5-40fb-acc9-7424164cb171 service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:27.731636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37a943-cde5-40fb-acc9-7424164cb171 service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:27.736667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd633-4cc9-461a-949c-17737465cced service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:27.737253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd633-4cc9-461a-949c-17737465cced service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:27.737581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd633-4cc9-461a-949c-17737465cced service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:27.737858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87dd633-4cc9-461a-949c-17737465cced service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:27.746385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dd633-4cc9-461a-949c-17737465cced service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:27.747983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87dd633-4cc9-461a-949c-17737465cced service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:27.755911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1313/2644] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:55:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:55:27.985277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb73641-9ecc-4dc5-b133-63cd7c822e9a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:27.985764 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb73641-9ecc-4dc5-b133-63cd7c822e9a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:27.985897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb73641-9ecc-4dc5-b133-63cd7c822e9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:28.006374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-bdb73641-9ecc-4dc5-b133-63cd7c822e9a None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:28.007774 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-bdb73641-9ecc-4dc5-b133-63cd7c822e9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:28.015878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1332/2645] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 17 00:55:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:28.028436 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd633-4cc9-461a-949c-17737465cced service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:28.038990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87dd633-4cc9-461a-949c-17737465cced service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:28.044051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcbfd7-7a59-4b44-8705-1f0d934d7e11 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:28.044643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcbfd7-7a59-4b44-8705-1f0d934d7e11 service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:28.044927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcbfd7-7a59-4b44-8705-1f0d934d7e11 service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:28.045201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfcbfd7-7a59-4b44-8705-1f0d934d7e11 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:28.053065 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcbfd7-7a59-4b44-8705-1f0d934d7e11 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:28.054690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfcbfd7-7a59-4b44-8705-1f0d934d7e11 service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:28.062823 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1314/2646] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:55:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:55:28.386802 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2375-33a5-4269-9a15-422f0c286f36 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:28.387091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2375-33a5-4269-9a15-422f0c286f36 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:28.387384 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f2375-33a5-4269-9a15-422f0c286f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:28.400633 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:28.406858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-e95f2375-33a5-4269-9a15-422f0c286f36 None None] MFA Rules not processed for user `e639d502dd3c46199da050a0f71de561`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:28.408105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e95f2375-33a5-4269-9a15-422f0c286f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:28.415842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1333/2647] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 17 00:55:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:28.428630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcbfd7-7a59-4b44-8705-1f0d934d7e11 service swift] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:28.442868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfcbfd7-7a59-4b44-8705-1f0d934d7e11 service swift] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:28.448909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ee27e1-9a2c-4db4-bdaf-c428cc336098 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6247f16e4bf6497183e40a7ed31ff23c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:28.449742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee27e1-9a2c-4db4-bdaf-c428cc336098 service swift] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:28.450037 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee27e1-9a2c-4db4-bdaf-c428cc336098 service swift] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:28.450298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ee27e1-9a2c-4db4-bdaf-c428cc336098 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:28.459288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee27e1-9a2c-4db4-bdaf-c428cc336098 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:28.461164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ee27e1-9a2c-4db4-bdaf-c428cc336098 service swift] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:28.469273 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1315/2648] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 17 00:55:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 17 00:55:30.586508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2375-33a5-4269-9a15-422f0c286f36 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:30.588413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e95f2375-33a5-4269-9a15-422f0c286f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:30.655434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f2375-33a5-4269-9a15-422f0c286f36 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:30.660116 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:30.665658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:30.665949 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:30.666227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] PATH_INFO: `/v3/users/25f373d364c041c28e732326525169a6` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:30.667434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25f373d364c041c28e732326525169a6)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:30.669373 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:30.718245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25f373d364c041c28e732326525169a6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:30.725286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25f373d364c041c28e732326525169a6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:30.725938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25f373d364c041c28e732326525169a6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:30.733158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25f373d364c041c28e732326525169a6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:30.745964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25f373d364c041c28e732326525169a6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:30.752211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1334/2649] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:30 2022] DELETE /identity/v3/users/25f373d364c041c28e732326525169a6 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:30.756694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9dd5a-1383-4e52-8c77-1de855a9f425 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:30.757162 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9dd5a-1383-4e52-8c77-1de855a9f425 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:30.757357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a9dd5a-1383-4e52-8c77-1de855a9f425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:30.777522 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-24a9dd5a-1383-4e52-8c77-1de855a9f425 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:30.778724 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-24a9dd5a-1383-4e52-8c77-1de855a9f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:30.787881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:30.843831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1316/2650] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:30.853980 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:30.855399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:30.911495 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543eb19b-a41a-41a0-a11c-2c107f21c243 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:30.915878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529f5c3-c694-4a07-8ac8-de6d800ae75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:30.916788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529f5c3-c694-4a07-8ac8-de6d800ae75d service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:30.917068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529f5c3-c694-4a07-8ac8-de6d800ae75d service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:30.917338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529f5c3-c694-4a07-8ac8-de6d800ae75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:30.926611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529f5c3-c694-4a07-8ac8-de6d800ae75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:30.928029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529f5c3-c694-4a07-8ac8-de6d800ae75d service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:30.938356 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1335/2651] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:31.120073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9dd5a-1383-4e52-8c77-1de855a9f425 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:31.122074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-24a9dd5a-1383-4e52-8c77-1de855a9f425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:31.135112 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a9dd5a-1383-4e52-8c77-1de855a9f425 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:31.140573 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:31.141384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.141845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.142127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] PATH_INFO: `/v3/projects/ee541330092648bfa69a0afe94215875` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.143281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee541330092648bfa69a0afe94215875)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:31.145235 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:31.204853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee541330092648bfa69a0afe94215875', 'request_id': 'req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:31.216877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee541330092648bfa69a0afe94215875', 'request_id': 'req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:31.222702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee541330092648bfa69a0afe94215875', 'request_id': 'req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:31.234379 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] The token cache is being invalidate because project ee541330092648bfa69a0afe94215875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:31.234704 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:31.235339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d91ba39c-cf7c-46cc-9b5f-7dfdf6234de8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:31.236842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1317/2652] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:31 2022] DELETE /identity/v3/projects/ee541330092648bfa69a0afe94215875 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:31.241850 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c41460-24bd-4ade-a1ab-f0778cdcf0db None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.242137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c41460-24bd-4ade-a1ab-f0778cdcf0db None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.242410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c41460-24bd-4ade-a1ab-f0778cdcf0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.261780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-a0c41460-24bd-4ade-a1ab-f0778cdcf0db None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:31.262944 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a0c41460-24bd-4ade-a1ab-f0778cdcf0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:31.280432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:31.324615 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1336/2653] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:31.332322 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0a29-ae91-42ca-b7ab-a47a00ff002c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.332613 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0a29-ae91-42ca-b7ab-a47a00ff002c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.332893 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd0a29-ae91-42ca-b7ab-a47a00ff002c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.353709 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-bccd0a29-ae91-42ca-b7ab-a47a00ff002c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:31.354921 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-bccd0a29-ae91-42ca-b7ab-a47a00ff002c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:31.362905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1318/2654] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:31.366939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c41460-24bd-4ade-a1ab-f0778cdcf0db None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:31.377592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c41460-24bd-4ade-a1ab-f0778cdcf0db None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:31.382099 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244814ea-704d-45cf-a081-22b6bce2c60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:31.382691 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244814ea-704d-45cf-a081-22b6bce2c60b admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.382975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244814ea-704d-45cf-a081-22b6bce2c60b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.383247 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244814ea-704d-45cf-a081-22b6bce2c60b admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.383885 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244814ea-704d-45cf-a081-22b6bce2c60b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:31.384186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244814ea-704d-45cf-a081-22b6bce2c60b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:31.385978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244814ea-704d-45cf-a081-22b6bce2c60b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:31.397796 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1337/2655] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:31.402577 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd0a29-ae91-42ca-b7ab-a47a00ff002c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:31.411829 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd0a29-ae91-42ca-b7ab-a47a00ff002c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:31.417426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffadbf-321c-49e8-8fc4-fb80b122ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:31.417998 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffadbf-321c-49e8-8fc4-fb80b122ba53 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.418280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffadbf-321c-49e8-8fc4-fb80b122ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.418585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffadbf-321c-49e8-8fc4-fb80b122ba53 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.419198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffadbf-321c-49e8-8fc4-fb80b122ba53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:31.421548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffadbf-321c-49e8-8fc4-fb80b122ba53 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:31.452132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1319/2656] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:31 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:31.456291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244814ea-704d-45cf-a081-22b6bce2c60b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:31.466952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244814ea-704d-45cf-a081-22b6bce2c60b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:31.520866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8de76f-0f1f-4263-957e-d0b099b0b1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:31.521485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8de76f-0f1f-4263-957e-d0b099b0b1f7 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.521768 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8de76f-0f1f-4263-957e-d0b099b0b1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.522044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8de76f-0f1f-4263-957e-d0b099b0b1f7 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.522671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8de76f-0f1f-4263-957e-d0b099b0b1f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:31.525075 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8de76f-0f1f-4263-957e-d0b099b0b1f7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:31.546600 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1338/2657] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:31 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:31.552369 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffadbf-321c-49e8-8fc4-fb80b122ba53 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:31.562500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffadbf-321c-49e8-8fc4-fb80b122ba53 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:31.567166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a67ce-1e87-4567-89f2-042cbe62f017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:31.567774 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a67ce-1e87-4567-89f2-042cbe62f017 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.568052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a67ce-1e87-4567-89f2-042cbe62f017 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.568324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a67ce-1e87-4567-89f2-042cbe62f017 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.568953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a67ce-1e87-4567-89f2-042cbe62f017 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:31.570572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90a67ce-1e87-4567-89f2-042cbe62f017 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:31.580685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1320/2658] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:31.584524 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8de76f-0f1f-4263-957e-d0b099b0b1f7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:31.595242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8de76f-0f1f-4263-957e-d0b099b0b1f7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:31.599836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da0117-f81b-4fe8-bbaa-520d767e6f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:31.600420 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da0117-f81b-4fe8-bbaa-520d767e6f2f admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.600701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da0117-f81b-4fe8-bbaa-520d767e6f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.600978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da0117-f81b-4fe8-bbaa-520d767e6f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.601657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da0117-f81b-4fe8-bbaa-520d767e6f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:31.603239 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da0117-f81b-4fe8-bbaa-520d767e6f2f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:31.614436 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1339/2659] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:31.618280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a67ce-1e87-4567-89f2-042cbe62f017 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:31.628159 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a67ce-1e87-4567-89f2-042cbe62f017 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:31.632746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c077f3-b2ba-419c-840f-6ed79a066787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:31.633385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c077f3-b2ba-419c-840f-6ed79a066787 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.633699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c077f3-b2ba-419c-840f-6ed79a066787 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.634496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c077f3-b2ba-419c-840f-6ed79a066787 admin admin] PATH_INFO: `/v3/projects/4793a09baab54915a3ab5d5c168a63e5/users/582b8f392e6e40b4bad7bbdfde7b5d79/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.649032 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c077f3-b2ba-419c-840f-6ed79a066787 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4793a09baab54915a3ab5d5c168a63e5, user_id=582b8f392e6e40b4bad7bbdfde7b5d79, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:31.652346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c077f3-b2ba-419c-840f-6ed79a066787 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:31.665551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1321/2660] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:31 2022] PUT /identity/v3/projects/4793a09baab54915a3ab5d5c168a63e5/users/582b8f392e6e40b4bad7bbdfde7b5d79/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:31.731463 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05512f5c-ea0f-4e61-a43d-e2ab14223503 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.731755 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05512f5c-ea0f-4e61-a43d-e2ab14223503 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.732032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05512f5c-ea0f-4e61-a43d-e2ab14223503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.760287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-05512f5c-ea0f-4e61-a43d-e2ab14223503 None None] MFA Rules not processed for user `582b8f392e6e40b4bad7bbdfde7b5d79`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:31.761519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-05512f5c-ea0f-4e61-a43d-e2ab14223503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:31.839838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1340/2661] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:31 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:31.854931 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c077f3-b2ba-419c-840f-6ed79a066787 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:31.857477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-50c077f3-b2ba-419c-840f-6ed79a066787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:31.909376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:31.930524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c077f3-b2ba-419c-840f-6ed79a066787 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:31.934693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3a8b-1566-4d8e-81f0-bb7267128778 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:31.935353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3a8b-1566-4d8e-81f0-bb7267128778 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:31.935578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3a8b-1566-4d8e-81f0-bb7267128778 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:31.935847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8e3a8b-1566-4d8e-81f0-bb7267128778 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:31.944332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3a8b-1566-4d8e-81f0-bb7267128778 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:31.945801 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8e3a8b-1566-4d8e-81f0-bb7267128778 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:31.955051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1322/2662] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:31 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:37.123783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05512f5c-ea0f-4e61-a43d-e2ab14223503 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:37.143863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:37.195211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05512f5c-ea0f-4e61-a43d-e2ab14223503 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:37.199834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:37.200476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:37.200753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:37.201031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] PATH_INFO: `/v3/users/582b8f392e6e40b4bad7bbdfde7b5d79` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:37.202195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=582b8f392e6e40b4bad7bbdfde7b5d79)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:37.204094 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:37.259462 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '582b8f392e6e40b4bad7bbdfde7b5d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:37.268627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '582b8f392e6e40b4bad7bbdfde7b5d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:37.269558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '582b8f392e6e40b4bad7bbdfde7b5d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:37.279137 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '582b8f392e6e40b4bad7bbdfde7b5d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:37.294951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3a8b-1566-4d8e-81f0-bb7267128778 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:37.296240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e80f795f-0f84-4bdb-9f32-cb2ec1ba52a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '582b8f392e6e40b4bad7bbdfde7b5d79'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:37.296605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-cb8e3a8b-1566-4d8e-81f0-bb7267128778 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:37.302797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1341/2663] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:37 2022] DELETE /identity/v3/users/582b8f392e6e40b4bad7bbdfde7b5d79 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:37.307156 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba91cb-42bb-4c49-9697-436d3200da67 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:37.307440 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba91cb-42bb-4c49-9697-436d3200da67 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:37.307723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba91cb-42bb-4c49-9697-436d3200da67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:37.326171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-7eba91cb-42bb-4c49-9697-436d3200da67 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:37.327347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7eba91cb-42bb-4c49-9697-436d3200da67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:37.353677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8e3a8b-1566-4d8e-81f0-bb7267128778 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:37.390211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1342/2664] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:37.400266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba91cb-42bb-4c49-9697-436d3200da67 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:37.402007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-7eba91cb-42bb-4c49-9697-436d3200da67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:37.409620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:37.410225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:37.410502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:37.410909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:37.417762 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:37.426990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:37.428790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:37.439300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1323/2665] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:55:37.448095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:37.464831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba91cb-42bb-4c49-9697-436d3200da67 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:37.468486 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af7aa-b886-451c-8369-69cd1efa116a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:37.469089 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af7aa-b886-451c-8369-69cd1efa116a service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:37.469363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af7aa-b886-451c-8369-69cd1efa116a service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:37.469661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2af7aa-b886-451c-8369-69cd1efa116a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:37.479106 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af7aa-b886-451c-8369-69cd1efa116a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:37.480525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2af7aa-b886-451c-8369-69cd1efa116a service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:37.489800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1343/2666] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:55:38.028990 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:38.030475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:38.043190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1225d50a-3249-43f6-a853-d9eddfc70934 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:38.048735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:38.049535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:38.049862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:38.050108 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] PATH_INFO: `/v3/users/4041db0a865e4969b946dabd6b9d2680` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:38.051973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4041db0a865e4969b946dabd6b9d2680)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:38.054270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:38.075332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af7aa-b886-451c-8369-69cd1efa116a service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:38.076900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4c2af7aa-b886-451c-8369-69cd1efa116a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:38.094006 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2af7aa-b886-451c-8369-69cd1efa116a service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:38.101762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:38.102431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:38.102790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:38.103110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] PATH_INFO: `/v3/projects/4793a09baab54915a3ab5d5c168a63e5` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:38.104651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4793a09baab54915a3ab5d5c168a63e5)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:38.107169 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:38.143327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4041db0a865e4969b946dabd6b9d2680'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.152996 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4041db0a865e4969b946dabd6b9d2680'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.153649 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4041db0a865e4969b946dabd6b9d2680'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.169897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4041db0a865e4969b946dabd6b9d2680'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.171400 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4793a09baab54915a3ab5d5c168a63e5', 'request_id': 'req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.179299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-df029a20-47f3-4d66-986a-2ad79b709b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4041db0a865e4969b946dabd6b9d2680'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.180363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4793a09baab54915a3ab5d5c168a63e5', 'request_id': 'req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.189936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1324/2667] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:38 2022] DELETE /identity/v3/users/4041db0a865e4969b946dabd6b9d2680 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:38.190143 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4793a09baab54915a3ab5d5c168a63e5', 'request_id': 'req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.192051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4bf55-2648-40bc-8e87-e04b18daa3f0 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:38.192398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4bf55-2648-40bc-8e87-e04b18daa3f0 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:38.192734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd4bf55-2648-40bc-8e87-e04b18daa3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:38.202376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] The token cache is being invalidate because project 4793a09baab54915a3ab5d5c168a63e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:38.202669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.203446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.205025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1344/2668] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:38 2022] DELETE /identity/v3/projects/4793a09baab54915a3ab5d5c168a63e5 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:38.214326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-acd4bf55-2648-40bc-8e87-e04b18daa3f0 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:38.215694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-acd4bf55-2648-40bc-8e87-e04b18daa3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:38.221746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:38.301636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1325/2669] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:38.313295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:38.315224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:38.387063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e193a5a7-5fe7-4fff-acf4-b3a79eea0123 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:38.448647 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bffd-8f94-47bf-8d1c-1b11a86a8081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:38.449306 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bffd-8f94-47bf-8d1c-1b11a86a8081 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:38.449637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bffd-8f94-47bf-8d1c-1b11a86a8081 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:38.449919 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bffd-8f94-47bf-8d1c-1b11a86a8081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:38.460527 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946bffd-8f94-47bf-8d1c-1b11a86a8081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:38.462485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946bffd-8f94-47bf-8d1c-1b11a86a8081 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:38.473899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1345/2670] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:38.742703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4bf55-2648-40bc-8e87-e04b18daa3f0 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:38.744816 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-acd4bf55-2648-40bc-8e87-e04b18daa3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:38.767821 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd4bf55-2648-40bc-8e87-e04b18daa3f0 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:38.774202 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:38.774946 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:38.775295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:38.775639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] PATH_INFO: `/v3/projects/96393268ee7547f49b4254e5e749c3c7` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:38.776862 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] RBAC: Authorizing `identity:delete_project(project_id=96393268ee7547f49b4254e5e749c3c7)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:38.778979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:38.827438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96393268ee7547f49b4254e5e749c3c7', 'request_id': 'req-16ed27af-2409-49e8-9d03-bd3427eef10e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.835167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96393268ee7547f49b4254e5e749c3c7', 'request_id': 'req-16ed27af-2409-49e8-9d03-bd3427eef10e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.841355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96393268ee7547f49b4254e5e749c3c7', 'request_id': 'req-16ed27af-2409-49e8-9d03-bd3427eef10e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.852552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] The token cache is being invalidate because project 96393268ee7547f49b4254e5e749c3c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:38.852839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.853516 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:38.855015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1326/2671] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:38 2022] DELETE /identity/v3/projects/96393268ee7547f49b4254e5e749c3c7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:38.859128 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bffd-8f94-47bf-8d1c-1b11a86a8081 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:38.869394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bffd-8f94-47bf-8d1c-1b11a86a8081 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:38.888243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:38.932505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:38.933155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:38.933461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:38.933742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] PATH_INFO: `/v3/users/d5b4a8f8540b450fbf5258b3f040c079` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:38.934951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5b4a8f8540b450fbf5258b3f040c079)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:38.937590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:38.998508 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5b4a8f8540b450fbf5258b3f040c079'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.005601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5b4a8f8540b450fbf5258b3f040c079'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.006231 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5b4a8f8540b450fbf5258b3f040c079'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.014027 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5b4a8f8540b450fbf5258b3f040c079'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.026981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-32ab3d88-8cdb-4c85-8ebb-2308a1488faa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5b4a8f8540b450fbf5258b3f040c079'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.035943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1346/2672] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:38 2022] DELETE /identity/v3/users/d5b4a8f8540b450fbf5258b3f040c079 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:39.473763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:39.475774 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:39.489656 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ed27af-2409-49e8-9d03-bd3427eef10e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:39.552631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:39.553271 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:39.553584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:39.553854 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] PATH_INFO: `/v3/projects/dd1d870d4ace466ea90707ebad697f0d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:39.555031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1d870d4ace466ea90707ebad697f0d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:39.556984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:39.595130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:39.608093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1d870d4ace466ea90707ebad697f0d', 'request_id': 'req-5a4d69b7-30ca-41ef-a080-e0646e5788a9'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.618713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1d870d4ace466ea90707ebad697f0d', 'request_id': 'req-5a4d69b7-30ca-41ef-a080-e0646e5788a9'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.624661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1d870d4ace466ea90707ebad697f0d', 'request_id': 'req-5a4d69b7-30ca-41ef-a080-e0646e5788a9'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.636607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] The token cache is being invalidate because project dd1d870d4ace466ea90707ebad697f0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:39.636914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.637628 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-5a4d69b7-30ca-41ef-a080-e0646e5788a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:39.639160 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1327/2673] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:39 2022] DELETE /identity/v3/projects/dd1d870d4ace466ea90707ebad697f0d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:39.644199 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6826b-5713-4024-a006-875595d6a7b4 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:39.644752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6826b-5713-4024-a006-875595d6a7b4 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:39.644869 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec6826b-5713-4024-a006-875595d6a7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:39.671266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-2ec6826b-5713-4024-a006-875595d6a7b4 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:39.672475 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2ec6826b-5713-4024-a006-875595d6a7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:39.732554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1347/2674] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:39.740292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a15e44-2180-44a9-a227-923ae17e8bf3 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:39.740606 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a15e44-2180-44a9-a227-923ae17e8bf3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:39.740884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a15e44-2180-44a9-a227-923ae17e8bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:39.761782 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-98a15e44-2180-44a9-a227-923ae17e8bf3 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:39.762972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-98a15e44-2180-44a9-a227-923ae17e8bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:39.771321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1328/2675] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:39.776082 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6826b-5713-4024-a006-875595d6a7b4 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:39.785672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec6826b-5713-4024-a006-875595d6a7b4 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:39.790868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd5e3-7524-434e-a816-fa1806b0b5e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:39.791471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd5e3-7524-434e-a816-fa1806b0b5e7 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:39.791753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd5e3-7524-434e-a816-fa1806b0b5e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:39.792024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663dd5e3-7524-434e-a816-fa1806b0b5e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:39.792670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd5e3-7524-434e-a816-fa1806b0b5e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:39.792974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd5e3-7524-434e-a816-fa1806b0b5e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:39.794596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663dd5e3-7524-434e-a816-fa1806b0b5e7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:39.806067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1348/2676] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:39.810534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a15e44-2180-44a9-a227-923ae17e8bf3 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:39.819727 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a15e44-2180-44a9-a227-923ae17e8bf3 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:39.830500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61c1b8-deb1-436a-a198-24381f068c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:39.831130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61c1b8-deb1-436a-a198-24381f068c47 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:39.831415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61c1b8-deb1-436a-a198-24381f068c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:39.831690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac61c1b8-deb1-436a-a198-24381f068c47 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:39.832658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61c1b8-deb1-436a-a198-24381f068c47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:39.834611 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac61c1b8-deb1-436a-a198-24381f068c47 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:39.868673 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1329/2677] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:39 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:39.869891 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd5e3-7524-434e-a816-fa1806b0b5e7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:39.880336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663dd5e3-7524-434e-a816-fa1806b0b5e7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:39.911242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:39.955636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620331-b7fc-406a-bdd4-11b9c24ad2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:39.956421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620331-b7fc-406a-bdd4-11b9c24ad2e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:39.956795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620331-b7fc-406a-bdd4-11b9c24ad2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:39.957165 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73620331-b7fc-406a-bdd4-11b9c24ad2e7 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:39.957964 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73620331-b7fc-406a-bdd4-11b9c24ad2e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:39.961039 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73620331-b7fc-406a-bdd4-11b9c24ad2e7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:39.987526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1349/2678] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:39 2022] POST /identity/v3/users => generated 289 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:39.991835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61c1b8-deb1-436a-a198-24381f068c47 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.003966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac61c1b8-deb1-436a-a198-24381f068c47 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.009386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6148-6809-48be-9d6f-2e12267673dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.010075 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6148-6809-48be-9d6f-2e12267673dc admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.010359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6148-6809-48be-9d6f-2e12267673dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.010634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e6148-6809-48be-9d6f-2e12267673dc admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.011358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e6148-6809-48be-9d6f-2e12267673dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:40.013018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e6148-6809-48be-9d6f-2e12267673dc admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:40.027000 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1330/2679] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:40.028201 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620331-b7fc-406a-bdd4-11b9c24ad2e7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.039000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73620331-b7fc-406a-bdd4-11b9c24ad2e7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.044509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8fa74d-5e83-4123-b1ca-fa5e0d389ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.045140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa74d-5e83-4123-b1ca-fa5e0d389ab4 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.046097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa74d-5e83-4123-b1ca-fa5e0d389ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.046097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8fa74d-5e83-4123-b1ca-fa5e0d389ab4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.046723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fa74d-5e83-4123-b1ca-fa5e0d389ab4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:40.048529 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8fa74d-5e83-4123-b1ca-fa5e0d389ab4 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:40.064871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1350/2680] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:40.066077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6148-6809-48be-9d6f-2e12267673dc admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.077584 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e6148-6809-48be-9d6f-2e12267673dc admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.082430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd29578-c0b9-4f93-a215-4bc00239cc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.083111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd29578-c0b9-4f93-a215-4bc00239cc31 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.083564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd29578-c0b9-4f93-a215-4bc00239cc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.084414 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd29578-c0b9-4f93-a215-4bc00239cc31 admin admin] PATH_INFO: `/v3/projects/9c5c82f4671a4f10948893c10466afde/users/f0ef975fc03042e790d5008e9fbe68b6/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.101677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd29578-c0b9-4f93-a215-4bc00239cc31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c5c82f4671a4f10948893c10466afde, user_id=f0ef975fc03042e790d5008e9fbe68b6, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:40.104943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd29578-c0b9-4f93-a215-4bc00239cc31 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:40.120798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1331/2681] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:40 2022] PUT /identity/v3/projects/9c5c82f4671a4f10948893c10466afde/users/f0ef975fc03042e790d5008e9fbe68b6/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:40.133157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f40cc7-320f-45f4-8eb7-8b2decee06d0 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.133469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f40cc7-320f-45f4-8eb7-8b2decee06d0 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.133778 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f40cc7-320f-45f4-8eb7-8b2decee06d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.164403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-10f40cc7-320f-45f4-8eb7-8b2decee06d0 None None] MFA Rules not processed for user `f0ef975fc03042e790d5008e9fbe68b6`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:40.166221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-10f40cc7-320f-45f4-8eb7-8b2decee06d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:40.249449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1351/2682] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:40.251965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd29578-c0b9-4f93-a215-4bc00239cc31 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.324427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd29578-c0b9-4f93-a215-4bc00239cc31 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.328585 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ccd78-53bc-4da3-a942-538a9f7f93ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.329278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ccd78-53bc-4da3-a942-538a9f7f93ef admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.329658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ccd78-53bc-4da3-a942-538a9f7f93ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.330003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7ccd78-53bc-4da3-a942-538a9f7f93ef admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.330744 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ccd78-53bc-4da3-a942-538a9f7f93ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:40.332820 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7ccd78-53bc-4da3-a942-538a9f7f93ef admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:40.367659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1332/2683] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:40 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:40.371625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f40cc7-320f-45f4-8eb7-8b2decee06d0 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.386465 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f40cc7-320f-45f4-8eb7-8b2decee06d0 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.458434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17288e-b8d1-49d9-b512-68da6a324728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.459058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17288e-b8d1-49d9-b512-68da6a324728 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.459395 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17288e-b8d1-49d9-b512-68da6a324728 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.459674 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17288e-b8d1-49d9-b512-68da6a324728 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.460333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17288e-b8d1-49d9-b512-68da6a324728 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:40.463568 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17288e-b8d1-49d9-b512-68da6a324728 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:40.510064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1352/2684] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:40 2022] POST /identity/v3/users => generated 296 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:40.511252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ccd78-53bc-4da3-a942-538a9f7f93ef admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.522498 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7ccd78-53bc-4da3-a942-538a9f7f93ef admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.527903 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1d072-8cc8-48d4-9d5e-bf8b204880e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.528599 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1d072-8cc8-48d4-9d5e-bf8b204880e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.528867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1d072-8cc8-48d4-9d5e-bf8b204880e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.529161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1d072-8cc8-48d4-9d5e-bf8b204880e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.530015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1d072-8cc8-48d4-9d5e-bf8b204880e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:40.532540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1d072-8cc8-48d4-9d5e-bf8b204880e8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:40.547100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1333/2685] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:40.548302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17288e-b8d1-49d9-b512-68da6a324728 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.558839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17288e-b8d1-49d9-b512-68da6a324728 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.564114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e3d2d-e226-4133-95c9-eeeafa2c1967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.565236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e3d2d-e226-4133-95c9-eeeafa2c1967 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.565460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e3d2d-e226-4133-95c9-eeeafa2c1967 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.565727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8e3d2d-e226-4133-95c9-eeeafa2c1967 admin admin] PATH_INFO: `/v3/projects/1b9c8abdf6d34db9a593590251be17c8/users/a94ca6ac84124f458a55c870ace32f62/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.588983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e3d2d-e226-4133-95c9-eeeafa2c1967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9c8abdf6d34db9a593590251be17c8, user_id=a94ca6ac84124f458a55c870ace32f62, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:40.592447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8e3d2d-e226-4133-95c9-eeeafa2c1967 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:40.614385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1353/2686] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:40 2022] PUT /identity/v3/projects/1b9c8abdf6d34db9a593590251be17c8/users/a94ca6ac84124f458a55c870ace32f62/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:40.615550 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1d072-8cc8-48d4-9d5e-bf8b204880e8 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.629100 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1d072-8cc8-48d4-9d5e-bf8b204880e8 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.665564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:40.701515 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05d07d2-6270-425e-bf28-119e4e871c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.702407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d07d2-6270-425e-bf28-119e4e871c72 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.702737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d07d2-6270-425e-bf28-119e4e871c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.703048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05d07d2-6270-425e-bf28-119e4e871c72 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.703689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d07d2-6270-425e-bf28-119e4e871c72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:40.705435 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05d07d2-6270-425e-bf28-119e4e871c72 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:40.717583 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1334/2687] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:40 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:40.721700 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e3d2d-e226-4133-95c9-eeeafa2c1967 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.738132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:40.742657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8e3d2d-e226-4133-95c9-eeeafa2c1967 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.751013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecc3f0-2018-4619-8356-78e6a194311f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.751693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecc3f0-2018-4619-8356-78e6a194311f admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.751972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecc3f0-2018-4619-8356-78e6a194311f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.752249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecc3f0-2018-4619-8356-78e6a194311f admin admin] PATH_INFO: `/v3/projects/1b9c8abdf6d34db9a593590251be17c8/users/a94ca6ac84124f458a55c870ace32f62/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.759780 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecc3f0-2018-4619-8356-78e6a194311f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b9c8abdf6d34db9a593590251be17c8, user_id=a94ca6ac84124f458a55c870ace32f62, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:40.768485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecc3f0-2018-4619-8356-78e6a194311f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:40.785456 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1354/2688] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:40 2022] PUT /identity/v3/projects/1b9c8abdf6d34db9a593590251be17c8/users/a94ca6ac84124f458a55c870ace32f62/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:40.792398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e61db-8feb-49e5-a37f-0aa39032f7a6 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.792690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e61db-8feb-49e5-a37f-0aa39032f7a6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.792968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8e61db-8feb-49e5-a37f-0aa39032f7a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:40.824006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7d8e61db-8feb-49e5-a37f-0aa39032f7a6 None None] MFA Rules not processed for user `a94ca6ac84124f458a55c870ace32f62`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:40.825285 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7d8e61db-8feb-49e5-a37f-0aa39032f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:40.894962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1335/2689] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:40.908359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecc3f0-2018-4619-8356-78e6a194311f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:40.909847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f2ecc3f0-2018-4619-8356-78e6a194311f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:40.980720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecc3f0-2018-4619-8356-78e6a194311f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:40.985216 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e644c3f-70f0-4386-9dab-e9b2e93b66a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:40.986581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e644c3f-70f0-4386-9dab-e9b2e93b66a1 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:40.986872 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e644c3f-70f0-4386-9dab-e9b2e93b66a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:40.987152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e644c3f-70f0-4386-9dab-e9b2e93b66a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:41.058886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e644c3f-70f0-4386-9dab-e9b2e93b66a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:41.060350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e644c3f-70f0-4386-9dab-e9b2e93b66a1 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:41.070790 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1355/2690] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:41.711490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e61db-8feb-49e5-a37f-0aa39032f7a6 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:41.715297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7d8e61db-8feb-49e5-a37f-0aa39032f7a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:41.801215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e644c3f-70f0-4386-9dab-e9b2e93b66a1 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:41.803350 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3e644c3f-70f0-4386-9dab-e9b2e93b66a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:41.830957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8e61db-8feb-49e5-a37f-0aa39032f7a6 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:41.839383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80460a68-a938-4fab-9cb7-5666b17784e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:41.840027 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460a68-a938-4fab-9cb7-5666b17784e7 service placement] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:41.841056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460a68-a938-4fab-9cb7-5666b17784e7 service placement] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:41.842015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80460a68-a938-4fab-9cb7-5666b17784e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:41.844366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-80460a68-a938-4fab-9cb7-5666b17784e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:41.857965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80460a68-a938-4fab-9cb7-5666b17784e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:41.859594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80460a68-a938-4fab-9cb7-5666b17784e7 service placement] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:41.870712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1336/2691] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:41.888328 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e644c3f-70f0-4386-9dab-e9b2e93b66a1 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:41.893686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:41.894567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:41.894849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:41.895123 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] PATH_INFO: `/v3/users/fc89c54d75e14107b79c30cabdb91ae1` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:41.896282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc89c54d75e14107b79c30cabdb91ae1)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:41.898229 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:41.949799 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:41.951899 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc89c54d75e14107b79c30cabdb91ae1'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:41.962715 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc89c54d75e14107b79c30cabdb91ae1'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:41.963643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc89c54d75e14107b79c30cabdb91ae1'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:41.975243 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc89c54d75e14107b79c30cabdb91ae1'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:41.989063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e9e0bc1f-1c0f-4863-a40c-33965477206d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc89c54d75e14107b79c30cabdb91ae1'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:41.996101 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1356/2692] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:41 2022] DELETE /identity/v3/users/fc89c54d75e14107b79c30cabdb91ae1 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:42.183332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80460a68-a938-4fab-9cb7-5666b17784e7 service placement] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:42.202698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80460a68-a938-4fab-9cb7-5666b17784e7 service placement] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:42.249042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:42.263952 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:42.264608 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.264892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.265166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] PATH_INFO: `/v3/projects/284b351f38d94be79f4625dd7026da79` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.266361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] RBAC: Authorizing `identity:delete_project(project_id=284b351f38d94be79f4625dd7026da79)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:42.268267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:42.315913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '284b351f38d94be79f4625dd7026da79', 'request_id': 'req-9d447d3e-7d2f-4b68-98a0-3bcee402431e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:42.322985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '284b351f38d94be79f4625dd7026da79', 'request_id': 'req-9d447d3e-7d2f-4b68-98a0-3bcee402431e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:42.328827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '284b351f38d94be79f4625dd7026da79', 'request_id': 'req-9d447d3e-7d2f-4b68-98a0-3bcee402431e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:42.340295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] The token cache is being invalidate because project 284b351f38d94be79f4625dd7026da79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:42.340581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:42.341218 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-9d447d3e-7d2f-4b68-98a0-3bcee402431e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:42.342719 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1337/2693] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:42 2022] DELETE /identity/v3/projects/284b351f38d94be79f4625dd7026da79 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:42.347540 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b034abb-abdc-44ed-b8a2-06d97eb68df6 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.347845 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b034abb-abdc-44ed-b8a2-06d97eb68df6 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.348121 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b034abb-abdc-44ed-b8a2-06d97eb68df6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.368720 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-9b034abb-abdc-44ed-b8a2-06d97eb68df6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:42.369970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9b034abb-abdc-44ed-b8a2-06d97eb68df6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:42.439895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1357/2694] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:42.448495 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6ec96-8af4-4abb-8398-c8a2b94a1fb6 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.448907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6ec96-8af4-4abb-8398-c8a2b94a1fb6 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.449245 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6ec96-8af4-4abb-8398-c8a2b94a1fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.469839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-36b6ec96-8af4-4abb-8398-c8a2b94a1fb6 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:42.471042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-36b6ec96-8af4-4abb-8398-c8a2b94a1fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:42.479704 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1338/2695] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:42.484798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b034abb-abdc-44ed-b8a2-06d97eb68df6 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:42.494516 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b034abb-abdc-44ed-b8a2-06d97eb68df6 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:42.499046 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cf7e8-dda8-4536-945d-51f57174e47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:42.499641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cf7e8-dda8-4536-945d-51f57174e47e admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.499918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cf7e8-dda8-4536-945d-51f57174e47e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.500191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6cf7e8-dda8-4536-945d-51f57174e47e admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.500832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cf7e8-dda8-4536-945d-51f57174e47e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:42.501164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cf7e8-dda8-4536-945d-51f57174e47e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:42.502779 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6cf7e8-dda8-4536-945d-51f57174e47e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:42.510259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6ec96-8af4-4abb-8398-c8a2b94a1fb6 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:42.511614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-36b6ec96-8af4-4abb-8398-c8a2b94a1fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:42.518058 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1358/2696] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:42.519372 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cf7e8-dda8-4536-945d-51f57174e47e admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:42.529667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6cf7e8-dda8-4536-945d-51f57174e47e admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:42.534375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bddda5-fab2-45b6-95a6-6dd9d1199688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:42.534987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bddda5-fab2-45b6-95a6-6dd9d1199688 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.535298 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bddda5-fab2-45b6-95a6-6dd9d1199688 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.535571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bddda5-fab2-45b6-95a6-6dd9d1199688 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.536191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bddda5-fab2-45b6-95a6-6dd9d1199688 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:42.538157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bddda5-fab2-45b6-95a6-6dd9d1199688 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:42.568880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1359/2697] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:42 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:42.569912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bddda5-fab2-45b6-95a6-6dd9d1199688 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:42.572905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6ec96-8af4-4abb-8398-c8a2b94a1fb6 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:42.624104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966317e9-a94a-4524-997a-e2129759c8a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:42.624657 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966317e9-a94a-4524-997a-e2129759c8a1 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.624940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966317e9-a94a-4524-997a-e2129759c8a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.625241 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966317e9-a94a-4524-997a-e2129759c8a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.627042 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-966317e9-a94a-4524-997a-e2129759c8a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:42.631414 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bddda5-fab2-45b6-95a6-6dd9d1199688 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:42.636061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7233f6-1c99-4e71-be2f-d21494d6e983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:42.636666 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7233f6-1c99-4e71-be2f-d21494d6e983 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.636948 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7233f6-1c99-4e71-be2f-d21494d6e983 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.637227 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7233f6-1c99-4e71-be2f-d21494d6e983 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.637896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7233f6-1c99-4e71-be2f-d21494d6e983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:42.639798 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7233f6-1c99-4e71-be2f-d21494d6e983 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:42.660930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1360/2698] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:42 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:42.665710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7233f6-1c99-4e71-be2f-d21494d6e983 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:42.668128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:42.676669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7233f6-1c99-4e71-be2f-d21494d6e983 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:42.681692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20666d-7127-482e-a9c7-9b4cb2b25924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:42.682303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20666d-7127-482e-a9c7-9b4cb2b25924 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.682571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20666d-7127-482e-a9c7-9b4cb2b25924 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.682846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b20666d-7127-482e-a9c7-9b4cb2b25924 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.683481 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20666d-7127-482e-a9c7-9b4cb2b25924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:42.685098 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b20666d-7127-482e-a9c7-9b4cb2b25924 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:42.695121 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966317e9-a94a-4524-997a-e2129759c8a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:42.695421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1361/2699] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:42.696695 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966317e9-a94a-4524-997a-e2129759c8a1 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:42.699374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20666d-7127-482e-a9c7-9b4cb2b25924 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:42.706781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1339/2700] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:55:42.708581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b20666d-7127-482e-a9c7-9b4cb2b25924 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:42.714203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e93ee-b76d-43c2-aab1-635ddca00c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:42.714735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e93ee-b76d-43c2-aab1-635ddca00c5a admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.715016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e93ee-b76d-43c2-aab1-635ddca00c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.715292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e93ee-b76d-43c2-aab1-635ddca00c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.716093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e93ee-b76d-43c2-aab1-635ddca00c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:42.717544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06e93ee-b76d-43c2-aab1-635ddca00c5a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:42.718887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:42.730389 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1362/2701] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:42.734427 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966317e9-a94a-4524-997a-e2129759c8a1 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:42.746004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966317e9-a94a-4524-997a-e2129759c8a1 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:42.750901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4074adb-230c-420f-9220-f9fe6e3fe4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:42.751560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4074adb-230c-420f-9220-f9fe6e3fe4f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.751835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4074adb-230c-420f-9220-f9fe6e3fe4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.752120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4074adb-230c-420f-9220-f9fe6e3fe4f0 admin admin] PATH_INFO: `/v3/projects/597f50e983454f1e88c6b334ba8d8e64/users/d8c23d9184204c3f9c665f3c3329dd19/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.767041 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4074adb-230c-420f-9220-f9fe6e3fe4f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=597f50e983454f1e88c6b334ba8d8e64, user_id=d8c23d9184204c3f9c665f3c3329dd19, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:42.770116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4074adb-230c-420f-9220-f9fe6e3fe4f0 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:42.784104 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1340/2702] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:42 2022] PUT /identity/v3/projects/597f50e983454f1e88c6b334ba8d8e64/users/d8c23d9184204c3f9c665f3c3329dd19/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:42.795458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdcbb7-f4e7-48bd-9e8c-51913a02c971 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.795742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdcbb7-f4e7-48bd-9e8c-51913a02c971 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.796013 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbdcbb7-f4e7-48bd-9e8c-51913a02c971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.830183 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-efbdcbb7-f4e7-48bd-9e8c-51913a02c971 None None] MFA Rules not processed for user `d8c23d9184204c3f9c665f3c3329dd19`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:42.831743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-efbdcbb7-f4e7-48bd-9e8c-51913a02c971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:42.908338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1363/2703] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:42 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:42.912737 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4074adb-230c-420f-9220-f9fe6e3fe4f0 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:42.980509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4074adb-230c-420f-9220-f9fe6e3fe4f0 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:42.985351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bfdd1-524b-4c9c-8d98-5f3dd7361e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:42.986004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bfdd1-524b-4c9c-8d98-5f3dd7361e02 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:42.986281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bfdd1-524b-4c9c-8d98-5f3dd7361e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:42.986551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6bfdd1-524b-4c9c-8d98-5f3dd7361e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:42.987182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bfdd1-524b-4c9c-8d98-5f3dd7361e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:42.989068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6bfdd1-524b-4c9c-8d98-5f3dd7361e02 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:43.014621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1341/2704] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:42 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:43.018656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdcbb7-f4e7-48bd-9e8c-51913a02c971 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:43.029198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbdcbb7-f4e7-48bd-9e8c-51913a02c971 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:43.083682 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78133-a39e-4164-92f4-17d25576ce76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:43.084410 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78133-a39e-4164-92f4-17d25576ce76 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.084805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78133-a39e-4164-92f4-17d25576ce76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.085130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da78133-a39e-4164-92f4-17d25576ce76 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.086061 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78133-a39e-4164-92f4-17d25576ce76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:43.088010 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da78133-a39e-4164-92f4-17d25576ce76 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:43.108973 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1364/2705] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:43 2022] POST /identity/v3/users => generated 309 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:43.112914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bfdd1-524b-4c9c-8d98-5f3dd7361e02 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:43.123909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6bfdd1-524b-4c9c-8d98-5f3dd7361e02 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:43.128422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d58f43-8f3a-4fd9-9f11-8e08ec9d2e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:43.129039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d58f43-8f3a-4fd9-9f11-8e08ec9d2e8e admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.129312 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d58f43-8f3a-4fd9-9f11-8e08ec9d2e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.129622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d58f43-8f3a-4fd9-9f11-8e08ec9d2e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.130257 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d58f43-8f3a-4fd9-9f11-8e08ec9d2e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:43.131902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d58f43-8f3a-4fd9-9f11-8e08ec9d2e8e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:43.142058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1342/2706] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:43.146208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78133-a39e-4164-92f4-17d25576ce76 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:43.156096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da78133-a39e-4164-92f4-17d25576ce76 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:43.160684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d829a7f-269d-4d79-9f3a-27031747a3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:43.161327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d829a7f-269d-4d79-9f3a-27031747a3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.161643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d829a7f-269d-4d79-9f3a-27031747a3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.161922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d829a7f-269d-4d79-9f3a-27031747a3ba admin admin] PATH_INFO: `/v3/projects/567c5f66baac4a7a84383e9730f3818a/users/cfeea8de4814439ba74b4777bf85e160/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.176822 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d829a7f-269d-4d79-9f3a-27031747a3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=567c5f66baac4a7a84383e9730f3818a, user_id=cfeea8de4814439ba74b4777bf85e160, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:43.179887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d829a7f-269d-4d79-9f3a-27031747a3ba admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:43.193066 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1365/2707] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:43 2022] PUT /identity/v3/projects/567c5f66baac4a7a84383e9730f3818a/users/cfeea8de4814439ba74b4777bf85e160/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:43.196913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d58f43-8f3a-4fd9-9f11-8e08ec9d2e8e admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:43.206666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d58f43-8f3a-4fd9-9f11-8e08ec9d2e8e admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:43.262733 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dab7bd-75f2-4a8c-bc20-30ba976e8599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:43.263336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dab7bd-75f2-4a8c-bc20-30ba976e8599 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.263615 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dab7bd-75f2-4a8c-bc20-30ba976e8599 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.263891 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dab7bd-75f2-4a8c-bc20-30ba976e8599 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.264527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dab7bd-75f2-4a8c-bc20-30ba976e8599 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:43.266185 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dab7bd-75f2-4a8c-bc20-30ba976e8599 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:43.276640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1343/2708] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:43.281016 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d829a7f-269d-4d79-9f3a-27031747a3ba admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:43.292638 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d829a7f-269d-4d79-9f3a-27031747a3ba admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:43.297315 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4a9d4-e98a-4202-b865-201dd1783302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:43.298007 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4a9d4-e98a-4202-b865-201dd1783302 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.298286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4a9d4-e98a-4202-b865-201dd1783302 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.298558 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d4a9d4-e98a-4202-b865-201dd1783302 admin admin] PATH_INFO: `/v3/projects/567c5f66baac4a7a84383e9730f3818a/users/cfeea8de4814439ba74b4777bf85e160/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.300496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4a9d4-e98a-4202-b865-201dd1783302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567c5f66baac4a7a84383e9730f3818a, user_id=cfeea8de4814439ba74b4777bf85e160, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:43.303191 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d4a9d4-e98a-4202-b865-201dd1783302 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:43.313365 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1366/2709] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:43 2022] PUT /identity/v3/projects/567c5f66baac4a7a84383e9730f3818a/users/cfeea8de4814439ba74b4777bf85e160/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:43.324765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d503e4-dd79-4400-9cb6-edfa3eae8f9e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.325090 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d503e4-dd79-4400-9cb6-edfa3eae8f9e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.325373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d503e4-dd79-4400-9cb6-edfa3eae8f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.354031 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f7d503e4-dd79-4400-9cb6-edfa3eae8f9e None None] MFA Rules not processed for user `cfeea8de4814439ba74b4777bf85e160`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:43.355238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f7d503e4-dd79-4400-9cb6-edfa3eae8f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:43.363345 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:43.423883 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1344/2710] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:43 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:43.434686 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4a9d4-e98a-4202-b865-201dd1783302 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:43.436380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b4d4a9d4-e98a-4202-b865-201dd1783302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:43.480300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:43.495987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d4a9d4-e98a-4202-b865-201dd1783302 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:43.499667 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9440fa-4960-497a-acc7-a94b1d9b8fab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:43.500264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9440fa-4960-497a-acc7-a94b1d9b8fab service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.500544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9440fa-4960-497a-acc7-a94b1d9b8fab service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.500816 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9440fa-4960-497a-acc7-a94b1d9b8fab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.509681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9440fa-4960-497a-acc7-a94b1d9b8fab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:43.511117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9440fa-4960-497a-acc7-a94b1d9b8fab service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:43.520307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1367/2711] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:43 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:43.658193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d503e4-dd79-4400-9cb6-edfa3eae8f9e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:43.721238 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d503e4-dd79-4400-9cb6-edfa3eae8f9e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:43.725926 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:43.726570 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.726844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.727113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] PATH_INFO: `/v3/users/d8c23d9184204c3f9c665f3c3329dd19` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.728295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8c23d9184204c3f9c665f3c3329dd19)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:43.730281 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:43.778537 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8c23d9184204c3f9c665f3c3329dd19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:43.787844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8c23d9184204c3f9c665f3c3329dd19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:43.788466 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8c23d9184204c3f9c665f3c3329dd19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:43.801891 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8c23d9184204c3f9c665f3c3329dd19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:43.809131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8c23d9184204c3f9c665f3c3329dd19'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:43.815319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1345/2712] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:43 2022] DELETE /identity/v3/users/d8c23d9184204c3f9c665f3c3329dd19 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:43.819884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a2042-40be-4a7f-ad08-8fccf4ca88c5 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.820176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a2042-40be-4a7f-ad08-8fccf4ca88c5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.820482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a2042-40be-4a7f-ad08-8fccf4ca88c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.840192 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-434a2042-40be-4a7f-ad08-8fccf4ca88c5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:43.841391 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-434a2042-40be-4a7f-ad08-8fccf4ca88c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:43.902230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1368/2713] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:43.912370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:43.914278 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:43.942048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:43.979376 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61024e9-edf0-4a58-b1cb-def85d159b70 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:43.982978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd2c25-05df-42a4-9201-822b9b8e5bc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:43.983596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd2c25-05df-42a4-9201-822b9b8e5bc2 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:43.983878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd2c25-05df-42a4-9201-822b9b8e5bc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:43.984160 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd2c25-05df-42a4-9201-822b9b8e5bc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:43.995243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd2c25-05df-42a4-9201-822b9b8e5bc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:43.998785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd2c25-05df-42a4-9201-822b9b8e5bc2 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:44.010323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1346/2714] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:44.388041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a2042-40be-4a7f-ad08-8fccf4ca88c5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:44.389959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-434a2042-40be-4a7f-ad08-8fccf4ca88c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:44.427381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a2042-40be-4a7f-ad08-8fccf4ca88c5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:44.433015 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:44.433797 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:44.434159 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:44.434506 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] PATH_INFO: `/v3/projects/597f50e983454f1e88c6b334ba8d8e64` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:44.435719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] RBAC: Authorizing `identity:delete_project(project_id=597f50e983454f1e88c6b334ba8d8e64)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:44.437726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:44.452687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd2c25-05df-42a4-9201-822b9b8e5bc2 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:44.462562 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd2c25-05df-42a4-9201-822b9b8e5bc2 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:44.467342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a857c-2e76-4825-8c01-9b8a86539753 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:44.467950 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a857c-2e76-4825-8c01-9b8a86539753 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:44.468230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a857c-2e76-4825-8c01-9b8a86539753 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:44.468509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a857c-2e76-4825-8c01-9b8a86539753 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:44.471093 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b19a857c-2e76-4825-8c01-9b8a86539753 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:44.492009 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597f50e983454f1e88c6b334ba8d8e64', 'request_id': 'req-5ea27c2d-732e-4190-ab5b-792027152092'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.499298 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597f50e983454f1e88c6b334ba8d8e64', 'request_id': 'req-5ea27c2d-732e-4190-ab5b-792027152092'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.505567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597f50e983454f1e88c6b334ba8d8e64', 'request_id': 'req-5ea27c2d-732e-4190-ab5b-792027152092'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.518012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] The token cache is being invalidate because project 597f50e983454f1e88c6b334ba8d8e64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:44.518429 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.519084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.520567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1369/2715] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:44 2022] DELETE /identity/v3/projects/597f50e983454f1e88c6b334ba8d8e64 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:44.524421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:44.525803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:44.549868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a857c-2e76-4825-8c01-9b8a86539753 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:44.551447 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a857c-2e76-4825-8c01-9b8a86539753 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:44.562640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1347/2716] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:44 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:55:44.594871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea27c2d-732e-4190-ab5b-792027152092 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:44.599585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:44.600233 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:44.600512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:44.600786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] PATH_INFO: `/v3/users/cfeea8de4814439ba74b4777bf85e160` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:44.602115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfeea8de4814439ba74b4777bf85e160)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:44.604584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:44.610040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:44.657294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfeea8de4814439ba74b4777bf85e160'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.666821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfeea8de4814439ba74b4777bf85e160'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.667553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfeea8de4814439ba74b4777bf85e160'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.677314 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfeea8de4814439ba74b4777bf85e160'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.691267 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-442d8504-c5ef-4090-9ec5-dcdce03c0d67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfeea8de4814439ba74b4777bf85e160'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:44.699807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1370/2717] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:44 2022] DELETE /identity/v3/users/cfeea8de4814439ba74b4777bf85e160 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:44.993170 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a857c-2e76-4825-8c01-9b8a86539753 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:45.012410 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a857c-2e76-4825-8c01-9b8a86539753 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:45.078094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:45.078735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.079018 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.079292 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] PATH_INFO: `/v3/projects/567c5f66baac4a7a84383e9730f3818a` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.080421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=567c5f66baac4a7a84383e9730f3818a)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:45.082469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:45.136188 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567c5f66baac4a7a84383e9730f3818a', 'request_id': 'req-0e89ee1f-d3cc-4cd6-8186-4fe000091851'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:45.143803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567c5f66baac4a7a84383e9730f3818a', 'request_id': 'req-0e89ee1f-d3cc-4cd6-8186-4fe000091851'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:45.149851 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:45.151402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567c5f66baac4a7a84383e9730f3818a', 'request_id': 'req-0e89ee1f-d3cc-4cd6-8186-4fe000091851'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:45.165323 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] The token cache is being invalidate because project 567c5f66baac4a7a84383e9730f3818a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:45.165640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:45.166326 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-0e89ee1f-d3cc-4cd6-8186-4fe000091851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:45.167898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1348/2718] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:44 2022] DELETE /identity/v3/projects/567c5f66baac4a7a84383e9730f3818a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:45.172752 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135c664-badd-474b-a144-5355e808c0e2 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.173238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135c664-badd-474b-a144-5355e808c0e2 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.173338 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8135c664-badd-474b-a144-5355e808c0e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.193668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8135c664-badd-474b-a144-5355e808c0e2 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:45.194904 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8135c664-badd-474b-a144-5355e808c0e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:45.257235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1371/2719] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:45.265688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470b41c-1963-4975-9077-497c1f138d32 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.265909 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470b41c-1963-4975-9077-497c1f138d32 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.266094 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b470b41c-1963-4975-9077-497c1f138d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.288269 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b470b41c-1963-4975-9077-497c1f138d32 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:45.289171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b470b41c-1963-4975-9077-497c1f138d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:45.297659 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1349/2720] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:45.302458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135c664-badd-474b-a144-5355e808c0e2 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:45.314054 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8135c664-badd-474b-a144-5355e808c0e2 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:45.321723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d868e-079e-4eb6-95ae-6738c72f3955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:45.322344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d868e-079e-4eb6-95ae-6738c72f3955 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.322996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d868e-079e-4eb6-95ae-6738c72f3955 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.322996 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d868e-079e-4eb6-95ae-6738c72f3955 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.323517 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d868e-079e-4eb6-95ae-6738c72f3955 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:45.323815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d868e-079e-4eb6-95ae-6738c72f3955 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:45.325392 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810d868e-079e-4eb6-95ae-6738c72f3955 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:45.342383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1372/2721] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:45.346691 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470b41c-1963-4975-9077-497c1f138d32 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:45.356579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b470b41c-1963-4975-9077-497c1f138d32 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:45.362225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b1c5a-4e0e-4ac4-8fbb-678453cbeda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:45.362846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1c5a-4e0e-4ac4-8fbb-678453cbeda1 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.363129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1c5a-4e0e-4ac4-8fbb-678453cbeda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.363423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603b1c5a-4e0e-4ac4-8fbb-678453cbeda1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.364074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b1c5a-4e0e-4ac4-8fbb-678453cbeda1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:45.366227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603b1c5a-4e0e-4ac4-8fbb-678453cbeda1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:45.407344 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1350/2722] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:45 2022] POST /identity/v3/projects => generated 369 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:45.421684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d868e-079e-4eb6-95ae-6738c72f3955 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:45.439545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d868e-079e-4eb6-95ae-6738c72f3955 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:45.513472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885921-c146-4ab0-8a0d-178cfd2e0062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:45.514258 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885921-c146-4ab0-8a0d-178cfd2e0062 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.514380 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885921-c146-4ab0-8a0d-178cfd2e0062 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.514664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4885921-c146-4ab0-8a0d-178cfd2e0062 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.515561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4885921-c146-4ab0-8a0d-178cfd2e0062 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:45.517717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4885921-c146-4ab0-8a0d-178cfd2e0062 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:45.536946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:45.545469 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1373/2723] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:45 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:45.547815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b1c5a-4e0e-4ac4-8fbb-678453cbeda1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:45.558815 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603b1c5a-4e0e-4ac4-8fbb-678453cbeda1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:45.563869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9fddb-e6f6-41e3-a93e-8abf96c382c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:45.564496 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9fddb-e6f6-41e3-a93e-8abf96c382c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.564775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9fddb-e6f6-41e3-a93e-8abf96c382c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.565054 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b9fddb-e6f6-41e3-a93e-8abf96c382c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.565775 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9fddb-e6f6-41e3-a93e-8abf96c382c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:45.567426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b9fddb-e6f6-41e3-a93e-8abf96c382c8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:45.579967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1351/2724] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:45.584055 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885921-c146-4ab0-8a0d-178cfd2e0062 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:45.595710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4885921-c146-4ab0-8a0d-178cfd2e0062 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:45.600592 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4f38b-faed-424b-be1d-bca8d1ad353d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:45.601194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4f38b-faed-424b-be1d-bca8d1ad353d admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.601501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4f38b-faed-424b-be1d-bca8d1ad353d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.602888 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4f38b-faed-424b-be1d-bca8d1ad353d admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.603025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4f38b-faed-424b-be1d-bca8d1ad353d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:45.604590 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4f38b-faed-424b-be1d-bca8d1ad353d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:45.616170 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1374/2725] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:45.620853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9fddb-e6f6-41e3-a93e-8abf96c382c8 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:45.633441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b9fddb-e6f6-41e3-a93e-8abf96c382c8 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:45.639744 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df82e68-769d-427c-b35c-dacf96063f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:45.639980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df82e68-769d-427c-b35c-dacf96063f01 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.640434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df82e68-769d-427c-b35c-dacf96063f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.640581 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df82e68-769d-427c-b35c-dacf96063f01 admin admin] PATH_INFO: `/v3/projects/2e3f96106f9446dcb0612caf911de5d0/users/6009b83b8ade420b970fe4181d077a90/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.659652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df82e68-769d-427c-b35c-dacf96063f01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e3f96106f9446dcb0612caf911de5d0, user_id=6009b83b8ade420b970fe4181d077a90, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:45.662541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df82e68-769d-427c-b35c-dacf96063f01 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:45.676797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1352/2726] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:45 2022] PUT /identity/v3/projects/2e3f96106f9446dcb0612caf911de5d0/users/6009b83b8ade420b970fe4181d077a90/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:45.687403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1d1c4-f74f-40a1-8929-4e37a5ab90f1 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.687696 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1d1c4-f74f-40a1-8929-4e37a5ab90f1 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.687977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1d1c4-f74f-40a1-8929-4e37a5ab90f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.720554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-10c1d1c4-f74f-40a1-8929-4e37a5ab90f1 None None] MFA Rules not processed for user `6009b83b8ade420b970fe4181d077a90`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:45.721833 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-10c1d1c4-f74f-40a1-8929-4e37a5ab90f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:45.791472 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1375/2727] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:45 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:45.796010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df82e68-769d-427c-b35c-dacf96063f01 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:45.861896 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df82e68-769d-427c-b35c-dacf96063f01 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:45.866928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902ed2-66a7-420f-83a6-7dbafbe0d455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:45.867546 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902ed2-66a7-420f-83a6-7dbafbe0d455 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.867869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902ed2-66a7-420f-83a6-7dbafbe0d455 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.868144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13902ed2-66a7-420f-83a6-7dbafbe0d455 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.868787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13902ed2-66a7-420f-83a6-7dbafbe0d455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:45.870776 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13902ed2-66a7-420f-83a6-7dbafbe0d455 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:45.902499 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1353/2728] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:45 2022] POST /identity/v3/projects => generated 369 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:45.903651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1d1c4-f74f-40a1-8929-4e37a5ab90f1 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:45.914507 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1d1c4-f74f-40a1-8929-4e37a5ab90f1 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:45.973438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc97e7-90be-493f-8425-d94024ec7a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:45.974078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc97e7-90be-493f-8425-d94024ec7a0e admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:45.974363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc97e7-90be-493f-8425-d94024ec7a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:45.974628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc97e7-90be-493f-8425-d94024ec7a0e admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:45.975268 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc97e7-90be-493f-8425-d94024ec7a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:45.977750 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc97e7-90be-493f-8425-d94024ec7a0e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:46.003307 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1376/2729] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:45 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:46.004841 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902ed2-66a7-420f-83a6-7dbafbe0d455 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:46.016924 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13902ed2-66a7-420f-83a6-7dbafbe0d455 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:46.021797 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fad1a-ced4-43a5-91c0-17820841d94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:46.022336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fad1a-ced4-43a5-91c0-17820841d94f admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:46.022619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fad1a-ced4-43a5-91c0-17820841d94f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:46.022961 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30fad1a-ced4-43a5-91c0-17820841d94f admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:46.023642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fad1a-ced4-43a5-91c0-17820841d94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:46.025247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30fad1a-ced4-43a5-91c0-17820841d94f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:46.036006 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1354/2730] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:46.040982 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc97e7-90be-493f-8425-d94024ec7a0e admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:46.050830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc97e7-90be-493f-8425-d94024ec7a0e admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:46.056138 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db205e-1ea3-43c9-90cd-059833593093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:46.056783 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db205e-1ea3-43c9-90cd-059833593093 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:46.057063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db205e-1ea3-43c9-90cd-059833593093 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:46.057335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db205e-1ea3-43c9-90cd-059833593093 admin admin] PATH_INFO: `/v3/projects/6609fa267e1743128a5d6a10e7ae3ea3/users/6864017aaa73486b9437aa69a088357f/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:46.072661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db205e-1ea3-43c9-90cd-059833593093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6609fa267e1743128a5d6a10e7ae3ea3, user_id=6864017aaa73486b9437aa69a088357f, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:46.075485 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db205e-1ea3-43c9-90cd-059833593093 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:46.091534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1377/2731] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:46 2022] PUT /identity/v3/projects/6609fa267e1743128a5d6a10e7ae3ea3/users/6864017aaa73486b9437aa69a088357f/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:46.095751 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fad1a-ced4-43a5-91c0-17820841d94f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:46.106424 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30fad1a-ced4-43a5-91c0-17820841d94f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:46.175941 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8235e8d-d767-4f7c-ad75-ef167ac50db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:46.176545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235e8d-d767-4f7c-ad75-ef167ac50db2 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:46.176824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235e8d-d767-4f7c-ad75-ef167ac50db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:46.177137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8235e8d-d767-4f7c-ad75-ef167ac50db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:46.177757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8235e8d-d767-4f7c-ad75-ef167ac50db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:46.179380 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8235e8d-d767-4f7c-ad75-ef167ac50db2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:46.182116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:46.191213 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1355/2732] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:46 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:46.195070 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db205e-1ea3-43c9-90cd-059833593093 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:46.205846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db205e-1ea3-43c9-90cd-059833593093 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:46.210470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2dc51-d1c2-4bd1-8499-58c845c99720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:46.211376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2dc51-d1c2-4bd1-8499-58c845c99720 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:46.212174 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2dc51-d1c2-4bd1-8499-58c845c99720 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:46.212449 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f2dc51-d1c2-4bd1-8499-58c845c99720 admin admin] PATH_INFO: `/v3/projects/6609fa267e1743128a5d6a10e7ae3ea3/users/6864017aaa73486b9437aa69a088357f/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:46.214411 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2dc51-d1c2-4bd1-8499-58c845c99720 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6609fa267e1743128a5d6a10e7ae3ea3, user_id=6864017aaa73486b9437aa69a088357f, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:46.217073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f2dc51-d1c2-4bd1-8499-58c845c99720 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:46.228118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1378/2733] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:46 2022] PUT /identity/v3/projects/6609fa267e1743128a5d6a10e7ae3ea3/users/6864017aaa73486b9437aa69a088357f/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:46.239555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db4f9-1ca3-4372-9859-8b739bd13280 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:46.239844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db4f9-1ca3-4372-9859-8b739bd13280 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:46.240119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776db4f9-1ca3-4372-9859-8b739bd13280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:46.268984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-776db4f9-1ca3-4372-9859-8b739bd13280 None None] MFA Rules not processed for user `6864017aaa73486b9437aa69a088357f`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:46.270230 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-776db4f9-1ca3-4372-9859-8b739bd13280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:46.339452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1356/2734] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:46 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:46.350854 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2dc51-d1c2-4bd1-8499-58c845c99720 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:46.352579 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-a0f2dc51-d1c2-4bd1-8499-58c845c99720 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:46.389697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:46.415148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f2dc51-d1c2-4bd1-8499-58c845c99720 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:46.418946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55da68-199b-422c-9532-1519df780425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:46.419631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55da68-199b-422c-9532-1519df780425 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:46.420316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55da68-199b-422c-9532-1519df780425 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:46.420316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55da68-199b-422c-9532-1519df780425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:46.433599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55da68-199b-422c-9532-1519df780425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:46.435067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55da68-199b-422c-9532-1519df780425 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:46.445557 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1379/2735] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:46 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:46.493484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db4f9-1ca3-4372-9859-8b739bd13280 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:46.494978 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-776db4f9-1ca3-4372-9859-8b739bd13280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:46.507291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776db4f9-1ca3-4372-9859-8b739bd13280 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:46.512020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35065e3-2d49-40e3-90a7-1e7208cfb1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:46.512817 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35065e3-2d49-40e3-90a7-1e7208cfb1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:46.513161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35065e3-2d49-40e3-90a7-1e7208cfb1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:46.513552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35065e3-2d49-40e3-90a7-1e7208cfb1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:46.587434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55da68-199b-422c-9532-1519df780425 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:46.589437 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6d55da68-199b-422c-9532-1519df780425 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:46.604072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35065e3-2d49-40e3-90a7-1e7208cfb1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:46.605992 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35065e3-2d49-40e3-90a7-1e7208cfb1c5 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:46.617224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1357/2736] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:46.672207 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55da68-199b-422c-9532-1519df780425 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:46.678231 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:46.679521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:46.679813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:46.680291 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] PATH_INFO: `/v3/users/f0ef975fc03042e790d5008e9fbe68b6` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:46.681534 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ef975fc03042e790d5008e9fbe68b6)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:46.684086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:46.752491 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ef975fc03042e790d5008e9fbe68b6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:46.761532 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ef975fc03042e790d5008e9fbe68b6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:46.762453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ef975fc03042e790d5008e9fbe68b6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:46.776251 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ef975fc03042e790d5008e9fbe68b6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:46.806336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ef975fc03042e790d5008e9fbe68b6'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:46.813970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1380/2737] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:46 2022] DELETE /identity/v3/users/f0ef975fc03042e790d5008e9fbe68b6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:46.818521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e56bf1-1f5b-4d7a-8970-936369bc8185 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:46.818867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e56bf1-1f5b-4d7a-8970-936369bc8185 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:46.819210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e56bf1-1f5b-4d7a-8970-936369bc8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:46.843857 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e3e56bf1-1f5b-4d7a-8970-936369bc8185 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:46.845284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e3e56bf1-1f5b-4d7a-8970-936369bc8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:46.924876 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1358/2738] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:46.936493 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:46.938366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:47.031439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9f3885-98e5-4fc9-b0f7-7345d99823ac admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:47.036907 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f2a41-9d3f-4686-a278-d1e4ab65ebd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:47.037628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f2a41-9d3f-4686-a278-d1e4ab65ebd8 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:47.037915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f2a41-9d3f-4686-a278-d1e4ab65ebd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:47.038193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f2a41-9d3f-4686-a278-d1e4ab65ebd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:47.067625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:47.070984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f2a41-9d3f-4686-a278-d1e4ab65ebd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:47.073047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f2a41-9d3f-4686-a278-d1e4ab65ebd8 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:47.084242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1381/2739] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:55:47.369225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e56bf1-1f5b-4d7a-8970-936369bc8185 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:47.370861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e3e56bf1-1f5b-4d7a-8970-936369bc8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:47.383666 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e56bf1-1f5b-4d7a-8970-936369bc8185 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:47.388836 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:47.389715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:47.389989 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:47.390431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] PATH_INFO: `/v3/projects/9c5c82f4671a4f10948893c10466afde` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:47.391582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c5c82f4671a4f10948893c10466afde)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:47.393763 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:47.420469 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:47.447907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c5c82f4671a4f10948893c10466afde', 'request_id': 'req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.458225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c5c82f4671a4f10948893c10466afde', 'request_id': 'req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.464940 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c5c82f4671a4f10948893c10466afde', 'request_id': 'req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.476040 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] The token cache is being invalidate because project 9c5c82f4671a4f10948893c10466afde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:47.476329 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.476974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.479049 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1359/2740] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:47 2022] DELETE /identity/v3/projects/9c5c82f4671a4f10948893c10466afde => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:47.483126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f2a41-9d3f-4686-a278-d1e4ab65ebd8 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:47.492678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f2a41-9d3f-4686-a278-d1e4ab65ebd8 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:47.549646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:47.550282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:47.550560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:47.550834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] PATH_INFO: `/v3/users/a94ca6ac84124f458a55c870ace32f62` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:47.551958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a94ca6ac84124f458a55c870ace32f62)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:47.553933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:47.603649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a94ca6ac84124f458a55c870ace32f62'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.611662 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a94ca6ac84124f458a55c870ace32f62'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.612358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a94ca6ac84124f458a55c870ace32f62'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.620497 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a94ca6ac84124f458a55c870ace32f62'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.632819 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-eacef2fe-4324-4848-805b-392f8fa0614a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a94ca6ac84124f458a55c870ace32f62'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:47.638863 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1382/2741] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:47 2022] DELETE /identity/v3/users/a94ca6ac84124f458a55c870ace32f62 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:47.901279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:47.902885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:47.917352 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94d9472-73ae-409c-af99-f1d0f0d6b8ec admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:47.973396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:47.974055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:47.974337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:47.974642 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] PATH_INFO: `/v3/projects/1b9c8abdf6d34db9a593590251be17c8` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:47.975761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b9c8abdf6d34db9a593590251be17c8)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:47.978298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.023741 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b9c8abdf6d34db9a593590251be17c8', 'request_id': 'req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:48.030901 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b9c8abdf6d34db9a593590251be17c8', 'request_id': 'req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:48.036808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b9c8abdf6d34db9a593590251be17c8', 'request_id': 'req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:48.047685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] The token cache is being invalidate because project 1b9c8abdf6d34db9a593590251be17c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:48.047974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:48.048600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-2b7ad4b9-1455-4bfd-8ca3-1053ef5dac81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:48.050103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1360/2742] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:47 2022] DELETE /identity/v3/projects/1b9c8abdf6d34db9a593590251be17c8 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:48.056175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb67ec-2912-4279-ae76-c618021e1e6b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.056458 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb67ec-2912-4279-ae76-c618021e1e6b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.056728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6beb67ec-2912-4279-ae76-c618021e1e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.076985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-6beb67ec-2912-4279-ae76-c618021e1e6b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:48.078248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-6beb67ec-2912-4279-ae76-c618021e1e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:48.139643 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1383/2743] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:48.147251 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081aad6-4668-4df7-8262-569197ea7553 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.147534 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081aad6-4668-4df7-8262-569197ea7553 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.147806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081aad6-4668-4df7-8262-569197ea7553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.168361 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-1081aad6-4668-4df7-8262-569197ea7553 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:48.169678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-1081aad6-4668-4df7-8262-569197ea7553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:48.177708 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1361/2744] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:48.182625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb67ec-2912-4279-ae76-c618021e1e6b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.196160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6beb67ec-2912-4279-ae76-c618021e1e6b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.200821 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f3e17-e05b-4bb4-9799-72caf3c8415e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.201477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3e17-e05b-4bb4-9799-72caf3c8415e admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.201761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3e17-e05b-4bb4-9799-72caf3c8415e admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.202032 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f3e17-e05b-4bb4-9799-72caf3c8415e admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.202668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f3e17-e05b-4bb4-9799-72caf3c8415e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:48.202968 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f3e17-e05b-4bb4-9799-72caf3c8415e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.204538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f3e17-e05b-4bb4-9799-72caf3c8415e admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.216825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1384/2745] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:48.221356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081aad6-4668-4df7-8262-569197ea7553 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.231398 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081aad6-4668-4df7-8262-569197ea7553 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.236119 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81e27-741e-4804-8140-490eca74440b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.236798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81e27-741e-4804-8140-490eca74440b admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.236969 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81e27-741e-4804-8140-490eca74440b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.237242 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81e27-741e-4804-8140-490eca74440b admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.237911 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b81e27-741e-4804-8140-490eca74440b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.240057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b81e27-741e-4804-8140-490eca74440b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.267490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1362/2746] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:48 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:48.271735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f3e17-e05b-4bb4-9799-72caf3c8415e admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.277072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:48.283760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f3e17-e05b-4bb4-9799-72caf3c8415e admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.342966 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91221f7d-ce0f-4f70-9820-88c1c06c9e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.343581 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91221f7d-ce0f-4f70-9820-88c1c06c9e4a admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.343860 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91221f7d-ce0f-4f70-9820-88c1c06c9e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.344131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91221f7d-ce0f-4f70-9820-88c1c06c9e4a admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.344767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91221f7d-ce0f-4f70-9820-88c1c06c9e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.346715 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91221f7d-ce0f-4f70-9820-88c1c06c9e4a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.368723 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1385/2747] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:48 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:48.373130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81e27-741e-4804-8140-490eca74440b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.383980 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81e27-741e-4804-8140-490eca74440b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.388869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31c3a-2e19-4b70-8ad4-c924aa183d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.389595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31c3a-2e19-4b70-8ad4-c924aa183d45 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.389874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31c3a-2e19-4b70-8ad4-c924aa183d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.390199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d31c3a-2e19-4b70-8ad4-c924aa183d45 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.390936 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31c3a-2e19-4b70-8ad4-c924aa183d45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.392554 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d31c3a-2e19-4b70-8ad4-c924aa183d45 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.393880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:48.407560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1363/2748] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:48.408814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91221f7d-ce0f-4f70-9820-88c1c06c9e4a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.419514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91221f7d-ce0f-4f70-9820-88c1c06c9e4a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.430938 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87413c70-0005-46a1-afb1-4221e8656bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.431804 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413c70-0005-46a1-afb1-4221e8656bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.432363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413c70-0005-46a1-afb1-4221e8656bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.432842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87413c70-0005-46a1-afb1-4221e8656bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.433601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87413c70-0005-46a1-afb1-4221e8656bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.435204 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87413c70-0005-46a1-afb1-4221e8656bc5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.450348 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1386/2749] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:48.451983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31c3a-2e19-4b70-8ad4-c924aa183d45 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.465670 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d31c3a-2e19-4b70-8ad4-c924aa183d45 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.482227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c96f2-c6f6-489c-b9ca-d09ce4dfd6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.485429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c96f2-c6f6-489c-b9ca-d09ce4dfd6de admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.485725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c96f2-c6f6-489c-b9ca-d09ce4dfd6de admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.486144 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c96f2-c6f6-489c-b9ca-d09ce4dfd6de admin admin] PATH_INFO: `/v3/projects/5117fb27f8bb4506bb956a4115f68639/users/0c0b33a1fde84566a4535e79bbfe8b77/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.523450 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c96f2-c6f6-489c-b9ca-d09ce4dfd6de admin admin] RBAC: Authorizing `identity:create_grant(project_id=5117fb27f8bb4506bb956a4115f68639, user_id=0c0b33a1fde84566a4535e79bbfe8b77, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.527336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c96f2-c6f6-489c-b9ca-d09ce4dfd6de admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.542214 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1364/2750] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:48 2022] PUT /identity/v3/projects/5117fb27f8bb4506bb956a4115f68639/users/0c0b33a1fde84566a4535e79bbfe8b77/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:48.553479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d151-4d3e-46ef-80ce-caf261fc4343 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.553994 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d151-4d3e-46ef-80ce-caf261fc4343 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.554158 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2d151-4d3e-46ef-80ce-caf261fc4343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.581264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ade2d151-4d3e-46ef-80ce-caf261fc4343 None None] MFA Rules not processed for user `0c0b33a1fde84566a4535e79bbfe8b77`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:48.582500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ade2d151-4d3e-46ef-80ce-caf261fc4343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:48.646248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1387/2751] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:48.651347 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c96f2-c6f6-489c-b9ca-d09ce4dfd6de admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.711298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c96f2-c6f6-489c-b9ca-d09ce4dfd6de admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.716473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a06fd-29ca-488e-b2d6-cfcedf019b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.717074 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a06fd-29ca-488e-b2d6-cfcedf019b64 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.717357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a06fd-29ca-488e-b2d6-cfcedf019b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.717665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a06fd-29ca-488e-b2d6-cfcedf019b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.718298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a06fd-29ca-488e-b2d6-cfcedf019b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.720199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a06fd-29ca-488e-b2d6-cfcedf019b64 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.746416 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1365/2752] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:48 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:48.750785 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d151-4d3e-46ef-80ce-caf261fc4343 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.761562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2d151-4d3e-46ef-80ce-caf261fc4343 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.818250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02e96-5ba0-410e-8629-889a2cfa2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.818857 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02e96-5ba0-410e-8629-889a2cfa2d75 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.819140 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02e96-5ba0-410e-8629-889a2cfa2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.819403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be02e96-5ba0-410e-8629-889a2cfa2d75 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.820031 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02e96-5ba0-410e-8629-889a2cfa2d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.822545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be02e96-5ba0-410e-8629-889a2cfa2d75 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.839422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:48.845665 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1388/2753] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:48 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:48.849891 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a06fd-29ca-488e-b2d6-cfcedf019b64 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.860096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a06fd-29ca-488e-b2d6-cfcedf019b64 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.864710 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b37474-a45d-4269-8290-7800d8ff252d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.865309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b37474-a45d-4269-8290-7800d8ff252d admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.865624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b37474-a45d-4269-8290-7800d8ff252d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.865900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b37474-a45d-4269-8290-7800d8ff252d admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.866578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b37474-a45d-4269-8290-7800d8ff252d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.868167 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b37474-a45d-4269-8290-7800d8ff252d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.878443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1366/2754] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:48.882521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02e96-5ba0-410e-8629-889a2cfa2d75 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.892848 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be02e96-5ba0-410e-8629-889a2cfa2d75 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:48.897488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f3309-f736-4cf3-a478-2cc07d41cbe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:48.898115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f3309-f736-4cf3-a478-2cc07d41cbe1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:48.898397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f3309-f736-4cf3-a478-2cc07d41cbe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:48.898673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f3309-f736-4cf3-a478-2cc07d41cbe1 admin admin] PATH_INFO: `/v3/projects/05e42099bf344100a6ede9c03b8ec949/users/ea8f54ee93db48798deef133dfc0d010/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:48.913900 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f3309-f736-4cf3-a478-2cc07d41cbe1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e42099bf344100a6ede9c03b8ec949, user_id=ea8f54ee93db48798deef133dfc0d010, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:48.916649 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f3309-f736-4cf3-a478-2cc07d41cbe1 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:48.929481 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1389/2755] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:48 2022] PUT /identity/v3/projects/05e42099bf344100a6ede9c03b8ec949/users/ea8f54ee93db48798deef133dfc0d010/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:48.933671 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b37474-a45d-4269-8290-7800d8ff252d admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:48.943483 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b37474-a45d-4269-8290-7800d8ff252d admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:49.000871 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864122d-69bf-4432-b603-7f345a68b19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:49.001508 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864122d-69bf-4432-b603-7f345a68b19a admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:49.001787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864122d-69bf-4432-b603-7f345a68b19a admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:49.002059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864122d-69bf-4432-b603-7f345a68b19a admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:49.002720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864122d-69bf-4432-b603-7f345a68b19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:49.004312 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864122d-69bf-4432-b603-7f345a68b19a admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:49.014459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1367/2756] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:49.018918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f3309-f736-4cf3-a478-2cc07d41cbe1 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:49.029642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f3309-f736-4cf3-a478-2cc07d41cbe1 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:49.034126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a4ef1-0da6-4acc-a972-0c0c20b01212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:49.034761 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a4ef1-0da6-4acc-a972-0c0c20b01212 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:49.035040 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a4ef1-0da6-4acc-a972-0c0c20b01212 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:49.035313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a4ef1-0da6-4acc-a972-0c0c20b01212 admin admin] PATH_INFO: `/v3/projects/05e42099bf344100a6ede9c03b8ec949/users/ea8f54ee93db48798deef133dfc0d010/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:49.037190 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a4ef1-0da6-4acc-a972-0c0c20b01212 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05e42099bf344100a6ede9c03b8ec949, user_id=ea8f54ee93db48798deef133dfc0d010, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:49.039861 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a4ef1-0da6-4acc-a972-0c0c20b01212 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:49.050353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1390/2757] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:49 2022] PUT /identity/v3/projects/05e42099bf344100a6ede9c03b8ec949/users/ea8f54ee93db48798deef133dfc0d010/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:49.061448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424c84-935a-434e-a0c1-b6b4c2c10fa5 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:49.061739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424c84-935a-434e-a0c1-b6b4c2c10fa5 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:49.062016 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e424c84-935a-434e-a0c1-b6b4c2c10fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:49.090455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8e424c84-935a-434e-a0c1-b6b4c2c10fa5 None None] MFA Rules not processed for user `ea8f54ee93db48798deef133dfc0d010`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:49.091676 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8e424c84-935a-434e-a0c1-b6b4c2c10fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:49.121577 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:49.159979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1368/2758] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:49.171091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a4ef1-0da6-4acc-a972-0c0c20b01212 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:49.172745 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-446a4ef1-0da6-4acc-a972-0c0c20b01212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:49.229808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a4ef1-0da6-4acc-a972-0c0c20b01212 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:49.233445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23b817-a537-43b0-b3c4-80cafda9972d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:49.234045 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23b817-a537-43b0-b3c4-80cafda9972d service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:49.234323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23b817-a537-43b0-b3c4-80cafda9972d service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:49.234605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23b817-a537-43b0-b3c4-80cafda9972d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:49.243942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23b817-a537-43b0-b3c4-80cafda9972d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:49.245354 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23b817-a537-43b0-b3c4-80cafda9972d service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:49.254509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1391/2759] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:49.357575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e424c84-935a-434e-a0c1-b6b4c2c10fa5 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:49.367087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e424c84-935a-434e-a0c1-b6b4c2c10fa5 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:49.371189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb89c68-0a0d-4550-9abd-3abd5e6a347b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:49.371785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb89c68-0a0d-4550-9abd-3abd5e6a347b service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:49.372066 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb89c68-0a0d-4550-9abd-3abd5e6a347b service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:49.372339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb89c68-0a0d-4550-9abd-3abd5e6a347b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:49.431212 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb89c68-0a0d-4550-9abd-3abd5e6a347b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:49.432665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb89c68-0a0d-4550-9abd-3abd5e6a347b service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:49.441384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1369/2760] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:49 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:50.129624 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23b817-a537-43b0-b3c4-80cafda9972d service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:50.131011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ae23b817-a537-43b0-b3c4-80cafda9972d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:50.209035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23b817-a537-43b0-b3c4-80cafda9972d service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:50.214363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:50.214994 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:50.215275 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:50.215555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] PATH_INFO: `/v3/users/6009b83b8ade420b970fe4181d077a90` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:50.216712 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6009b83b8ade420b970fe4181d077a90)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:50.218678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:50.263594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6009b83b8ade420b970fe4181d077a90'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.270544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6009b83b8ade420b970fe4181d077a90'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.271172 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6009b83b8ade420b970fe4181d077a90'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.278623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6009b83b8ade420b970fe4181d077a90'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.282988 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:50.292511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6009b83b8ade420b970fe4181d077a90'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.298775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1392/2761] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:50 2022] DELETE /identity/v3/users/6009b83b8ade420b970fe4181d077a90 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:50.303543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6c23-0c3b-4607-865c-ab4f692300f3 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:50.303833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6c23-0c3b-4607-865c-ab4f692300f3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:50.304115 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06e6c23-0c3b-4607-865c-ab4f692300f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:50.324467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-b06e6c23-0c3b-4607-865c-ab4f692300f3 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:50.325711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b06e6c23-0c3b-4607-865c-ab4f692300f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:50.384576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1370/2762] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:50.394244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:50.395608 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:50.462801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7f855-d1b7-49d5-9e7c-fdfa2cca3b17 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:50.466366 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55555309-9b8d-40db-be41-98d7f9b6fabd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:50.466965 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55555309-9b8d-40db-be41-98d7f9b6fabd service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:50.467242 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55555309-9b8d-40db-be41-98d7f9b6fabd service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:50.467513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55555309-9b8d-40db-be41-98d7f9b6fabd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:50.476203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55555309-9b8d-40db-be41-98d7f9b6fabd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:50.477708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55555309-9b8d-40db-be41-98d7f9b6fabd service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:50.487117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1393/2763] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:55:50.745353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e6c23-0c3b-4607-865c-ab4f692300f3 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:50.746839 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-b06e6c23-0c3b-4607-865c-ab4f692300f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:50.759757 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06e6c23-0c3b-4607-865c-ab4f692300f3 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:50.764484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:50.765116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:50.765394 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:50.766222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] PATH_INFO: `/v3/projects/2e3f96106f9446dcb0612caf911de5d0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:50.767545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e3f96106f9446dcb0612caf911de5d0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:50.769485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:50.817702 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e3f96106f9446dcb0612caf911de5d0', 'request_id': 'req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.826472 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e3f96106f9446dcb0612caf911de5d0', 'request_id': 'req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.830723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:50.833299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e3f96106f9446dcb0612caf911de5d0', 'request_id': 'req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.848913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] The token cache is being invalidate because project 2e3f96106f9446dcb0612caf911de5d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:50.849206 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.849888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.851372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1371/2764] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:50 2022] DELETE /identity/v3/projects/2e3f96106f9446dcb0612caf911de5d0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:50.855393 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55555309-9b8d-40db-be41-98d7f9b6fabd service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:50.865154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55555309-9b8d-40db-be41-98d7f9b6fabd service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:50.927282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:50.927913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:50.928230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:50.928505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] PATH_INFO: `/v3/users/6864017aaa73486b9437aa69a088357f` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:50.929632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6864017aaa73486b9437aa69a088357f)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:50.932086 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:50.978317 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6864017aaa73486b9437aa69a088357f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.986273 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6864017aaa73486b9437aa69a088357f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.986977 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6864017aaa73486b9437aa69a088357f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:50.994983 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6864017aaa73486b9437aa69a088357f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:51.007321 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-42eb5616-61b5-42ba-a5c0-8682b48b43d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6864017aaa73486b9437aa69a088357f'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:51.014412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1394/2765] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:50 2022] DELETE /identity/v3/users/6864017aaa73486b9437aa69a088357f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:51.288591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:51.290605 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:51.303956 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753894e2-0b40-42f1-8ac5-83bbb1ca8ce1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:51.360296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:51.360965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.361247 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.361566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] PATH_INFO: `/v3/projects/6609fa267e1743128a5d6a10e7ae3ea3` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.362691 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6609fa267e1743128a5d6a10e7ae3ea3)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:51.364610 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:51.409365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6609fa267e1743128a5d6a10e7ae3ea3', 'request_id': 'req-c85b57db-1a86-4285-b015-d3cc7712ab43'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:51.416846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6609fa267e1743128a5d6a10e7ae3ea3', 'request_id': 'req-c85b57db-1a86-4285-b015-d3cc7712ab43'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:51.423129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6609fa267e1743128a5d6a10e7ae3ea3', 'request_id': 'req-c85b57db-1a86-4285-b015-d3cc7712ab43'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:51.435045 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] The token cache is being invalidate because project 6609fa267e1743128a5d6a10e7ae3ea3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:51.435336 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:51.435988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c85b57db-1a86-4285-b015-d3cc7712ab43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:51.437725 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1372/2766] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:51 2022] DELETE /identity/v3/projects/6609fa267e1743128a5d6a10e7ae3ea3 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:51.442397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275558-3018-41d2-9f13-62c0cf807a68 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.442864 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275558-3018-41d2-9f13-62c0cf807a68 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.442984 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b275558-3018-41d2-9f13-62c0cf807a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.456381 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:51.465008 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3b275558-3018-41d2-9f13-62c0cf807a68 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:51.466794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3b275558-3018-41d2-9f13-62c0cf807a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:51.529244 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1395/2767] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:51.536994 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e10cc-c476-4c94-9d39-80e9d9d729d3 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.537279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e10cc-c476-4c94-9d39-80e9d9d729d3 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.537602 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5e10cc-c476-4c94-9d39-80e9d9d729d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.558661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0e5e10cc-c476-4c94-9d39-80e9d9d729d3 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:51.559867 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0e5e10cc-c476-4c94-9d39-80e9d9d729d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:51.567912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1373/2768] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:51.572231 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b275558-3018-41d2-9f13-62c0cf807a68 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:51.581769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b275558-3018-41d2-9f13-62c0cf807a68 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:51.587110 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ae43b-21ba-4be6-b7f3-4b80be0c1ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:51.587695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ae43b-21ba-4be6-b7f3-4b80be0c1ae3 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.587972 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ae43b-21ba-4be6-b7f3-4b80be0c1ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.588240 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ae43b-21ba-4be6-b7f3-4b80be0c1ae3 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.588880 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ae43b-21ba-4be6-b7f3-4b80be0c1ae3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:51.589177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ae43b-21ba-4be6-b7f3-4b80be0c1ae3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:51.590800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ae43b-21ba-4be6-b7f3-4b80be0c1ae3 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:51.601997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1396/2769] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:51.606825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e10cc-c476-4c94-9d39-80e9d9d729d3 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:51.615832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5e10cc-c476-4c94-9d39-80e9d9d729d3 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:51.620464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd121ee7-765f-48e4-8999-abb52241ca4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:51.621083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd121ee7-765f-48e4-8999-abb52241ca4c admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.621357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd121ee7-765f-48e4-8999-abb52241ca4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.621661 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd121ee7-765f-48e4-8999-abb52241ca4c admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.622290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd121ee7-765f-48e4-8999-abb52241ca4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:51.624176 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd121ee7-765f-48e4-8999-abb52241ca4c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:51.650595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1374/2770] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:51 2022] POST /identity/v3/projects => generated 407 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:51.654660 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ae43b-21ba-4be6-b7f3-4b80be0c1ae3 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:51.665330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ae43b-21ba-4be6-b7f3-4b80be0c1ae3 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:51.719515 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf843eb-d540-4f61-adac-6481de1d0e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:51.720108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf843eb-d540-4f61-adac-6481de1d0e84 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.720383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf843eb-d540-4f61-adac-6481de1d0e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.720651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf843eb-d540-4f61-adac-6481de1d0e84 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.721276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf843eb-d540-4f61-adac-6481de1d0e84 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:51.723208 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf843eb-d540-4f61-adac-6481de1d0e84 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:51.744185 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1397/2771] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:51 2022] POST /identity/v3/users => generated 304 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:51.748386 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd121ee7-765f-48e4-8999-abb52241ca4c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:51.758680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd121ee7-765f-48e4-8999-abb52241ca4c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:51.763327 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94918cee-d7a5-4f24-aa25-b0b52684b2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:51.763927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94918cee-d7a5-4f24-aa25-b0b52684b2da admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.764210 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94918cee-d7a5-4f24-aa25-b0b52684b2da admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.764486 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94918cee-d7a5-4f24-aa25-b0b52684b2da admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.765131 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94918cee-d7a5-4f24-aa25-b0b52684b2da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:51.766791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94918cee-d7a5-4f24-aa25-b0b52684b2da admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:51.776917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1375/2772] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:51.780963 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf843eb-d540-4f61-adac-6481de1d0e84 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:51.791355 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf843eb-d540-4f61-adac-6481de1d0e84 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:51.796051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a647b2-77f9-4944-b102-0909d48449bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:51.796631 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a647b2-77f9-4944-b102-0909d48449bc admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.796906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a647b2-77f9-4944-b102-0909d48449bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.797175 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a647b2-77f9-4944-b102-0909d48449bc admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.797874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a647b2-77f9-4944-b102-0909d48449bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:51.799434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a647b2-77f9-4944-b102-0909d48449bc admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:51.809788 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1398/2773] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:51.813784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94918cee-d7a5-4f24-aa25-b0b52684b2da admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:51.824123 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94918cee-d7a5-4f24-aa25-b0b52684b2da admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:51.828827 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b591c7-2d0e-4dff-9e2d-034fbb0165fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:51.829579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b591c7-2d0e-4dff-9e2d-034fbb0165fd admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.829858 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b591c7-2d0e-4dff-9e2d-034fbb0165fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.830138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b591c7-2d0e-4dff-9e2d-034fbb0165fd admin admin] PATH_INFO: `/v3/projects/c278b6143e2245ac82ab74282fed0b7f/users/31349e1d7d614e2585cc9629a9baa702/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.849225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b591c7-2d0e-4dff-9e2d-034fbb0165fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c278b6143e2245ac82ab74282fed0b7f, user_id=31349e1d7d614e2585cc9629a9baa702, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:51.852068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b591c7-2d0e-4dff-9e2d-034fbb0165fd admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:51.865536 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1376/2774] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:51 2022] PUT /identity/v3/projects/c278b6143e2245ac82ab74282fed0b7f/users/31349e1d7d614e2585cc9629a9baa702/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:51.878313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c2c8-a539-4b5c-b385-039412eecbe5 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:51.878905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c2c8-a539-4b5c-b385-039412eecbe5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:51.879248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f6c2c8-a539-4b5c-b385-039412eecbe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:51.907478 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-85f6c2c8-a539-4b5c-b385-039412eecbe5 None None] MFA Rules not processed for user `31349e1d7d614e2585cc9629a9baa702`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:51.908676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-85f6c2c8-a539-4b5c-b385-039412eecbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:51.971311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1399/2775] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:51 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:51.975799 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b591c7-2d0e-4dff-9e2d-034fbb0165fd admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:51.993017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:52.038843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b591c7-2d0e-4dff-9e2d-034fbb0165fd admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.043509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f5e07-c3ef-4336-b042-a27e8f17bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.044111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f5e07-c3ef-4336-b042-a27e8f17bcfc admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.044397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f5e07-c3ef-4336-b042-a27e8f17bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.044693 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43f5e07-c3ef-4336-b042-a27e8f17bcfc admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.045305 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f5e07-c3ef-4336-b042-a27e8f17bcfc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.047249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a43f5e07-c3ef-4336-b042-a27e8f17bcfc admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.075942 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c2c8-a539-4b5c-b385-039412eecbe5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.076099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1377/2776] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:51 2022] POST /identity/v3/projects => generated 409 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:52.077668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-85f6c2c8-a539-4b5c-b385-039412eecbe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:52.079822 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f5e07-c3ef-4336-b042-a27e8f17bcfc admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.085995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:52.092921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f6c2c8-a539-4b5c-b385-039412eecbe5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.144543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43f5e07-c3ef-4336-b042-a27e8f17bcfc admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.149964 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb17f-282c-49bc-adf0-6ef0d8804129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.150576 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb17f-282c-49bc-adf0-6ef0d8804129 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.150855 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb17f-282c-49bc-adf0-6ef0d8804129 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.151137 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615fb17f-282c-49bc-adf0-6ef0d8804129 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.151769 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fb17f-282c-49bc-adf0-6ef0d8804129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.153723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615fb17f-282c-49bc-adf0-6ef0d8804129 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.156394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.157033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.157316 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.157635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] PATH_INFO: `/v3/users/0c0b33a1fde84566a4535e79bbfe8b77` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.158773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c0b33a1fde84566a4535e79bbfe8b77)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.160684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.175677 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1378/2777] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:52 2022] POST /identity/v3/users => generated 311 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:52.179669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb17f-282c-49bc-adf0-6ef0d8804129 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.190953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615fb17f-282c-49bc-adf0-6ef0d8804129 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.197715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156c561-0837-40f7-936b-d628d755a6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.198321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156c561-0837-40f7-936b-d628d755a6bb admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.198601 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156c561-0837-40f7-936b-d628d755a6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.198877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156c561-0837-40f7-936b-d628d755a6bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.199548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156c561-0837-40f7-936b-d628d755a6bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.201174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156c561-0837-40f7-936b-d628d755a6bb admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.210353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c0b33a1fde84566a4535e79bbfe8b77'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.212357 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1379/2778] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:52.217036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156c561-0837-40f7-936b-d628d755a6bb admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.219347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c0b33a1fde84566a4535e79bbfe8b77'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.219975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c0b33a1fde84566a4535e79bbfe8b77'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.226987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c0b33a1fde84566a4535e79bbfe8b77'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.227350 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156c561-0837-40f7-936b-d628d755a6bb admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.232068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44d70e-0311-4ace-b84c-007dcf228967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.232703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44d70e-0311-4ace-b84c-007dcf228967 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.232983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44d70e-0311-4ace-b84c-007dcf228967 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.233259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a44d70e-0311-4ace-b84c-007dcf228967 admin admin] PATH_INFO: `/v3/projects/c87d1f9506ce401aa88e5cf2fbdb8e1d/users/ad33ea19c5b1495cbdf364173b790800/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.240157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-1fd4fb3a-0455-418c-b51c-db93d4f682f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c0b33a1fde84566a4535e79bbfe8b77'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.246859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1400/2779] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:52 2022] DELETE /identity/v3/users/0c0b33a1fde84566a4535e79bbfe8b77 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:52.248316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44d70e-0311-4ace-b84c-007dcf228967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87d1f9506ce401aa88e5cf2fbdb8e1d, user_id=ad33ea19c5b1495cbdf364173b790800, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.251171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3b94d-107b-47d3-8b15-d0a209154625 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.251413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a44d70e-0311-4ace-b84c-007dcf228967 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.251535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3b94d-107b-47d3-8b15-d0a209154625 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.251722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3b94d-107b-47d3-8b15-d0a209154625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.265324 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1380/2780] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:52 2022] PUT /identity/v3/projects/c87d1f9506ce401aa88e5cf2fbdb8e1d/users/ad33ea19c5b1495cbdf364173b790800/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:52.269124 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44d70e-0311-4ace-b84c-007dcf228967 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.270793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9a44d70e-0311-4ace-b84c-007dcf228967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:52.270987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-50d3b94d-107b-47d3-8b15-d0a209154625 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:52.272146 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-50d3b94d-107b-47d3-8b15-d0a209154625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:52.332122 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:52.334095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1401/2781] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:52.342174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a44d70e-0311-4ace-b84c-007dcf228967 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.344701 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3b94d-107b-47d3-8b15-d0a209154625 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.346035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-50d3b94d-107b-47d3-8b15-d0a209154625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:52.347464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f421e-f8fc-485d-94e0-51ea31c39ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.348077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f421e-f8fc-485d-94e0-51ea31c39ada admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.348354 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f421e-f8fc-485d-94e0-51ea31c39ada admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.348701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f421e-f8fc-485d-94e0-51ea31c39ada admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.349267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f421e-f8fc-485d-94e0-51ea31c39ada admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.351053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f421e-f8fc-485d-94e0-51ea31c39ada admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.361128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1381/2782] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:52 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:52.365055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f421e-f8fc-485d-94e0-51ea31c39ada admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.373224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:52.375899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f421e-f8fc-485d-94e0-51ea31c39ada admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.381139 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26ca9e-f111-46ef-aa57-636817278098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.381824 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26ca9e-f111-46ef-aa57-636817278098 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.382110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26ca9e-f111-46ef-aa57-636817278098 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.382384 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26ca9e-f111-46ef-aa57-636817278098 admin admin] PATH_INFO: `/v3/projects/c87d1f9506ce401aa88e5cf2fbdb8e1d/users/ad33ea19c5b1495cbdf364173b790800/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.385158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26ca9e-f111-46ef-aa57-636817278098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c87d1f9506ce401aa88e5cf2fbdb8e1d, user_id=ad33ea19c5b1495cbdf364173b790800, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.387833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be26ca9e-f111-46ef-aa57-636817278098 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.398406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1382/2783] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:52 2022] PUT /identity/v3/projects/c87d1f9506ce401aa88e5cf2fbdb8e1d/users/ad33ea19c5b1495cbdf364173b790800/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:52.409383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3b94d-107b-47d3-8b15-d0a209154625 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.409675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e32f5c-e980-452c-af00-292c7226fe4d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.409967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e32f5c-e980-452c-af00-292c7226fe4d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.410252 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e32f5c-e980-452c-af00-292c7226fe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.442606 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-01e32f5c-e980-452c-af00-292c7226fe4d None None] MFA Rules not processed for user `ad33ea19c5b1495cbdf364173b790800`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:52.443812 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-01e32f5c-e980-452c-af00-292c7226fe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:52.467818 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca42a-1c8f-4134-a12b-059453b94672 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.468437 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca42a-1c8f-4134-a12b-059453b94672 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.468717 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca42a-1c8f-4134-a12b-059453b94672 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.468990 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05ca42a-1c8f-4134-a12b-059453b94672 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.513015 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1383/2784] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:52 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:52.524488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e32f5c-e980-452c-af00-292c7226fe4d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.525873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-01e32f5c-e980-452c-af00-292c7226fe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:52.530602 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ca42a-1c8f-4134-a12b-059453b94672 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.532044 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05ca42a-1c8f-4134-a12b-059453b94672 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.542213 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1402/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:55:52.588010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e32f5c-e980-452c-af00-292c7226fe4d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.591875 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921e59c-ba88-4dcd-8c15-87c680848304 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.592679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e59c-ba88-4dcd-8c15-87c680848304 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.592944 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e59c-ba88-4dcd-8c15-87c680848304 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.593168 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f921e59c-ba88-4dcd-8c15-87c680848304 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.603491 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921e59c-ba88-4dcd-8c15-87c680848304 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.604967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f921e59c-ba88-4dcd-8c15-87c680848304 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.614947 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1384/2786] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:52 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:55:52.786664 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca42a-1c8f-4134-a12b-059453b94672 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.796895 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05ca42a-1c8f-4134-a12b-059453b94672 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.800932 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a643b8-f7c4-462c-b97c-0dc318ac3a68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.801569 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a643b8-f7c4-462c-b97c-0dc318ac3a68 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.801855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a643b8-f7c4-462c-b97c-0dc318ac3a68 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.802130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a643b8-f7c4-462c-b97c-0dc318ac3a68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.804117 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-21a643b8-f7c4-462c-b97c-0dc318ac3a68 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:52.817726 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921e59c-ba88-4dcd-8c15-87c680848304 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.819211 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f921e59c-ba88-4dcd-8c15-87c680848304 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:52.833988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f921e59c-ba88-4dcd-8c15-87c680848304 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.839557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:52.840267 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:52.840623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:52.840977 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] PATH_INFO: `/v3/projects/5117fb27f8bb4506bb956a4115f68639` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:52.842223 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5117fb27f8bb4506bb956a4115f68639)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.844233 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.878640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a643b8-f7c4-462c-b97c-0dc318ac3a68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:52.880288 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a643b8-f7c4-462c-b97c-0dc318ac3a68 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:52.893973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5117fb27f8bb4506bb956a4115f68639', 'request_id': 'req-3d9af242-ab77-4656-bda5-7b41a2d2b790'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.894218 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1403/2787] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:52 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:52.903291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5117fb27f8bb4506bb956a4115f68639', 'request_id': 'req-3d9af242-ab77-4656-bda5-7b41a2d2b790'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.907287 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:52.910714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5117fb27f8bb4506bb956a4115f68639', 'request_id': 'req-3d9af242-ab77-4656-bda5-7b41a2d2b790'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.923939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] The token cache is being invalidate because project 5117fb27f8bb4506bb956a4115f68639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:52.924232 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.924879 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:52.926377 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1385/2788] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:52 2022] DELETE /identity/v3/projects/5117fb27f8bb4506bb956a4115f68639 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:52.930874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a643b8-f7c4-462c-b97c-0dc318ac3a68 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:52.941304 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a643b8-f7c4-462c-b97c-0dc318ac3a68 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:52.966413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=100 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:53.000024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:53.000773 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.001131 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.001511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] PATH_INFO: `/v3/users/ea8f54ee93db48798deef133dfc0d010` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.002738 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea8f54ee93db48798deef133dfc0d010)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:53.004651 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:53.053616 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea8f54ee93db48798deef133dfc0d010'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.061868 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea8f54ee93db48798deef133dfc0d010'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.062526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea8f54ee93db48798deef133dfc0d010'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.072565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea8f54ee93db48798deef133dfc0d010'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.085553 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-481e9d12-fc6b-4f34-94cc-5a6e54bd7fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea8f54ee93db48798deef133dfc0d010'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.092073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1404/2789] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:52 2022] DELETE /identity/v3/users/ea8f54ee93db48798deef133dfc0d010 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:53.374068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:53.375684 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:53.391047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9af242-ab77-4656-bda5-7b41a2d2b790 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:53.451051 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:53.451688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.451965 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.452243 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] PATH_INFO: `/v3/projects/05e42099bf344100a6ede9c03b8ec949` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.453355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05e42099bf344100a6ede9c03b8ec949)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:53.455318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:53.500064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05e42099bf344100a6ede9c03b8ec949', 'request_id': 'req-d8200a2d-c3aa-4115-8765-93c16ee547f1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.506798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05e42099bf344100a6ede9c03b8ec949', 'request_id': 'req-d8200a2d-c3aa-4115-8765-93c16ee547f1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.512196 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05e42099bf344100a6ede9c03b8ec949', 'request_id': 'req-d8200a2d-c3aa-4115-8765-93c16ee547f1'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.523039 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] The token cache is being invalidate because project 05e42099bf344100a6ede9c03b8ec949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:53.523331 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.524011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-d8200a2d-c3aa-4115-8765-93c16ee547f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:53.525514 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1386/2790] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:53 2022] DELETE /identity/v3/projects/05e42099bf344100a6ede9c03b8ec949 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:53.530432 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9939b8-d8ed-4e3e-bfd0-445bc6c45343 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.530939 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9939b8-d8ed-4e3e-bfd0-445bc6c45343 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.531035 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9939b8-d8ed-4e3e-bfd0-445bc6c45343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.550518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-3e9939b8-d8ed-4e3e-bfd0-445bc6c45343 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:53.551693 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-3e9939b8-d8ed-4e3e-bfd0-445bc6c45343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:53.609045 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1405/2791] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:53.617984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fbf0c-c29d-47bd-abbb-ce12fb8dc023 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.618773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fbf0c-c29d-47bd-abbb-ce12fb8dc023 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.618773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fbf0c-c29d-47bd-abbb-ce12fb8dc023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.638338 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-fc4fbf0c-c29d-47bd-abbb-ce12fb8dc023 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:53.639519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-fc4fbf0c-c29d-47bd-abbb-ce12fb8dc023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:53.647299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1387/2792] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:53.651992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9939b8-d8ed-4e3e-bfd0-445bc6c45343 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:53.661525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9939b8-d8ed-4e3e-bfd0-445bc6c45343 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:53.666501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394b1e1-d1a2-4a82-b356-4e14190f36ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:53.667088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394b1e1-d1a2-4a82-b356-4e14190f36ff admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.667363 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394b1e1-d1a2-4a82-b356-4e14190f36ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.667632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394b1e1-d1a2-4a82-b356-4e14190f36ff admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.668266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394b1e1-d1a2-4a82-b356-4e14190f36ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:53.668560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394b1e1-d1a2-4a82-b356-4e14190f36ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:53.670261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394b1e1-d1a2-4a82-b356-4e14190f36ff admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:53.681998 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1406/2793] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:53.686158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fbf0c-c29d-47bd-abbb-ce12fb8dc023 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:53.695201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fbf0c-c29d-47bd-abbb-ce12fb8dc023 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:53.700370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43330b89-33cb-4acc-9946-b92a7a2391eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:53.700960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43330b89-33cb-4acc-9946-b92a7a2391eb admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.701236 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43330b89-33cb-4acc-9946-b92a7a2391eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.701548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43330b89-33cb-4acc-9946-b92a7a2391eb admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.702169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43330b89-33cb-4acc-9946-b92a7a2391eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:53.704092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43330b89-33cb-4acc-9946-b92a7a2391eb admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:53.731707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1388/2794] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:53 2022] POST /identity/v3/projects => generated 361 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:53.736386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394b1e1-d1a2-4a82-b356-4e14190f36ff admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:53.747510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394b1e1-d1a2-4a82-b356-4e14190f36ff admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:53.776722 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:53.804561 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f10206-1aee-4ccc-8da0-5a97cf0fa983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:53.805730 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f10206-1aee-4ccc-8da0-5a97cf0fa983 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.806012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f10206-1aee-4ccc-8da0-5a97cf0fa983 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.806289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f10206-1aee-4ccc-8da0-5a97cf0fa983 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.806916 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f10206-1aee-4ccc-8da0-5a97cf0fa983 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:53.808843 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f10206-1aee-4ccc-8da0-5a97cf0fa983 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:53.829096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1407/2795] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:53 2022] POST /identity/v3/users => generated 281 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:53.833150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43330b89-33cb-4acc-9946-b92a7a2391eb admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:53.843463 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43330b89-33cb-4acc-9946-b92a7a2391eb admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:53.848033 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9894ab-7242-46d8-aee7-391b7fb0b748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:53.848621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9894ab-7242-46d8-aee7-391b7fb0b748 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.848897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9894ab-7242-46d8-aee7-391b7fb0b748 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.849166 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9894ab-7242-46d8-aee7-391b7fb0b748 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.849832 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9894ab-7242-46d8-aee7-391b7fb0b748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:53.851421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9894ab-7242-46d8-aee7-391b7fb0b748 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:53.861030 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1389/2796] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:53.864800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f10206-1aee-4ccc-8da0-5a97cf0fa983 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:53.876603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f10206-1aee-4ccc-8da0-5a97cf0fa983 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:53.881505 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b391bdf8-7bc1-4c32-86d0-8b42d1329e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:53.882095 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391bdf8-7bc1-4c32-86d0-8b42d1329e95 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.882376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391bdf8-7bc1-4c32-86d0-8b42d1329e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.882646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b391bdf8-7bc1-4c32-86d0-8b42d1329e95 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.883890 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391bdf8-7bc1-4c32-86d0-8b42d1329e95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:53.885488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b391bdf8-7bc1-4c32-86d0-8b42d1329e95 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:53.895959 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1408/2797] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:53.900061 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9894ab-7242-46d8-aee7-391b7fb0b748 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:53.910082 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9894ab-7242-46d8-aee7-391b7fb0b748 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:53.914705 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bd53f-668a-4e5d-98db-6babdd3c607d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:53.915335 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bd53f-668a-4e5d-98db-6babdd3c607d admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:53.915614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bd53f-668a-4e5d-98db-6babdd3c607d admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:53.915890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449bd53f-668a-4e5d-98db-6babdd3c607d admin admin] PATH_INFO: `/v3/projects/520e2be8f28940e397a78501b517d034/users/fd59515c4a364c9ca1ecb2e08cb772fc/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:53.930568 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bd53f-668a-4e5d-98db-6babdd3c607d admin admin] RBAC: Authorizing `identity:create_grant(project_id=520e2be8f28940e397a78501b517d034, user_id=fd59515c4a364c9ca1ecb2e08cb772fc, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:53.933222 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449bd53f-668a-4e5d-98db-6babdd3c607d admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:53.946261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1390/2798] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:53 2022] PUT /identity/v3/projects/520e2be8f28940e397a78501b517d034/users/fd59515c4a364c9ca1ecb2e08cb772fc/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:54.012113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c32cb2-ffe5-4241-8057-03e9beb14a09 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:54.012528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c32cb2-ffe5-4241-8057-03e9beb14a09 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:54.012829 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c32cb2-ffe5-4241-8057-03e9beb14a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:54.039658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-70c32cb2-ffe5-4241-8057-03e9beb14a09 None None] MFA Rules not processed for user `fd59515c4a364c9ca1ecb2e08cb772fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:54.040876 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-70c32cb2-ffe5-4241-8057-03e9beb14a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:54.104614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1409/2799] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:54.138717 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bd53f-668a-4e5d-98db-6babdd3c607d admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:54.140415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-449bd53f-668a-4e5d-98db-6babdd3c607d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:54.158474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:54.203658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449bd53f-668a-4e5d-98db-6babdd3c607d admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:54.207312 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae7a24-74ea-4bdd-a4a1-29c8924dfe04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:54.207918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae7a24-74ea-4bdd-a4a1-29c8924dfe04 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:54.208198 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae7a24-74ea-4bdd-a4a1-29c8924dfe04 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:54.208473 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae7a24-74ea-4bdd-a4a1-29c8924dfe04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:54.216788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae7a24-74ea-4bdd-a4a1-29c8924dfe04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:54.218255 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae7a24-74ea-4bdd-a4a1-29c8924dfe04 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:54.228835 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1391/2800] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:54.244654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c32cb2-ffe5-4241-8057-03e9beb14a09 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:54.307956 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c32cb2-ffe5-4241-8057-03e9beb14a09 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:54.313226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:54.313892 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:54.314177 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:54.314518 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] PATH_INFO: `/v3/users/fd59515c4a364c9ca1ecb2e08cb772fc` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:54.315594 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd59515c4a364c9ca1ecb2e08cb772fc)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:54.317525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:54.366311 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:54.370855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd59515c4a364c9ca1ecb2e08cb772fc'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:54.379585 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd59515c4a364c9ca1ecb2e08cb772fc'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:54.380375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd59515c4a364c9ca1ecb2e08cb772fc'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:54.387479 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd59515c4a364c9ca1ecb2e08cb772fc'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:54.399552 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd59515c4a364c9ca1ecb2e08cb772fc'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:54.407224 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1410/2801] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:54 2022] DELETE /identity/v3/users/fd59515c4a364c9ca1ecb2e08cb772fc => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:54.412272 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc95af-7ff9-44a6-92e1-ba61eb8f0aae None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:54.412779 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc95af-7ff9-44a6-92e1-ba61eb8f0aae None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:54.413062 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbc95af-7ff9-44a6-92e1-ba61eb8f0aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:54.445173 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-0cbc95af-7ff9-44a6-92e1-ba61eb8f0aae None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:54.446739 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0cbc95af-7ff9-44a6-92e1-ba61eb8f0aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:54.512152 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1392/2802] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:55:54.521841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:54.523250 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:54.583728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb93a7-e10c-441a-9095-153640ad8eca admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:54.588333 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325b0cc5-9867-43e9-bbdf-da576e186358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:54.588987 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0cc5-9867-43e9-bbdf-da576e186358 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:54.589299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0cc5-9867-43e9-bbdf-da576e186358 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:54.589586 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325b0cc5-9867-43e9-bbdf-da576e186358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:54.599782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b0cc5-9867-43e9-bbdf-da576e186358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:54.601301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325b0cc5-9867-43e9-bbdf-da576e186358 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:54.612494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1411/2803] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:54.903089 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc95af-7ff9-44a6-92e1-ba61eb8f0aae None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:54.904942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-0cbc95af-7ff9-44a6-92e1-ba61eb8f0aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:54.918288 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbc95af-7ff9-44a6-92e1-ba61eb8f0aae None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:54.923145 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:54.923781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:54.924190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:54.924459 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] PATH_INFO: `/v3/projects/520e2be8f28940e397a78501b517d034` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:54.925620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=520e2be8f28940e397a78501b517d034)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:54.927559 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:54.978138 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '520e2be8f28940e397a78501b517d034', 'request_id': 'req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:54.986226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '520e2be8f28940e397a78501b517d034', 'request_id': 'req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:54.991927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '520e2be8f28940e397a78501b517d034', 'request_id': 'req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:55.003688 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] The token cache is being invalidate because project 520e2be8f28940e397a78501b517d034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:55.004069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:55.004806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a3b50ae7-f919-4ac9-bd72-8e8e73dc8472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:55.006535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1393/2804] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:54 2022] DELETE /identity/v3/projects/520e2be8f28940e397a78501b517d034 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:55.011993 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a7579-655c-4fcf-a481-569377b47fb5 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.012300 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a7579-655c-4fcf-a481-569377b47fb5 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.012572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1a7579-655c-4fcf-a481-569377b47fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.034370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-8b1a7579-655c-4fcf-a481-569377b47fb5 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:55.035571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8b1a7579-655c-4fcf-a481-569377b47fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:55.094570 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1412/2805] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:55.102579 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435ba8-01b4-4b1a-aed0-422c84e8c68e None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.102865 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435ba8-01b4-4b1a-aed0-422c84e8c68e None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.103146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435ba8-01b4-4b1a-aed0-422c84e8c68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.122814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-e5435ba8-01b4-4b1a-aed0-422c84e8c68e None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:55.124025 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-e5435ba8-01b4-4b1a-aed0-422c84e8c68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:55.132088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1394/2806] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:55.137108 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a7579-655c-4fcf-a481-569377b47fb5 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.146838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1a7579-655c-4fcf-a481-569377b47fb5 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.152801 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d60d75-5e36-465d-944f-54e0c3cad091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.153457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d60d75-5e36-465d-944f-54e0c3cad091 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.153743 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d60d75-5e36-465d-944f-54e0c3cad091 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.154019 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d60d75-5e36-465d-944f-54e0c3cad091 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.154669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d60d75-5e36-465d-944f-54e0c3cad091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:55.154974 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d60d75-5e36-465d-944f-54e0c3cad091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.156619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d60d75-5e36-465d-944f-54e0c3cad091 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.169470 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1413/2807] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:55.173953 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435ba8-01b4-4b1a-aed0-422c84e8c68e None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.183712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435ba8-01b4-4b1a-aed0-422c84e8c68e None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.188286 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da474ded-4841-4806-8229-149461403801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.188882 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da474ded-4841-4806-8229-149461403801 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.189160 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da474ded-4841-4806-8229-149461403801 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.189454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da474ded-4841-4806-8229-149461403801 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.190085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da474ded-4841-4806-8229-149461403801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.191985 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da474ded-4841-4806-8229-149461403801 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.220596 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1395/2808] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:55 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:55.225197 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d60d75-5e36-465d-944f-54e0c3cad091 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.235245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d60d75-5e36-465d-944f-54e0c3cad091 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.285149 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:55.296115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb093a-1798-429e-9780-c4c21df551fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.296913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb093a-1798-429e-9780-c4c21df551fa admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.297259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb093a-1798-429e-9780-c4c21df551fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.297836 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb093a-1798-429e-9780-c4c21df551fa admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.298514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb093a-1798-429e-9780-c4c21df551fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.300632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb093a-1798-429e-9780-c4c21df551fa admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.323166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1414/2809] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:55 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:55.327315 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da474ded-4841-4806-8229-149461403801 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.338785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da474ded-4841-4806-8229-149461403801 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.343490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c940418-9310-4edc-90d8-0cef883bad05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.344098 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c940418-9310-4edc-90d8-0cef883bad05 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.344441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c940418-9310-4edc-90d8-0cef883bad05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.344652 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c940418-9310-4edc-90d8-0cef883bad05 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.345300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c940418-9310-4edc-90d8-0cef883bad05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.346942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c940418-9310-4edc-90d8-0cef883bad05 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.357458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1396/2810] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:55.361313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb093a-1798-429e-9780-c4c21df551fa admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.371634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb093a-1798-429e-9780-c4c21df551fa admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.376115 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3a3bf-6fd5-4ada-b7ba-0a264c44d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.376728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3a3bf-6fd5-4ada-b7ba-0a264c44d602 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.377003 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3a3bf-6fd5-4ada-b7ba-0a264c44d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.377272 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3a3bf-6fd5-4ada-b7ba-0a264c44d602 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.377930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3a3bf-6fd5-4ada-b7ba-0a264c44d602 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.379501 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3a3bf-6fd5-4ada-b7ba-0a264c44d602 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.390756 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1415/2811] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:55.395226 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c940418-9310-4edc-90d8-0cef883bad05 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.400528 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:55.407552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c940418-9310-4edc-90d8-0cef883bad05 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.413300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98f632-b34c-4761-9352-a7da7100b074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.414047 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f632-b34c-4761-9352-a7da7100b074 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.414342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f632-b34c-4761-9352-a7da7100b074 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.414614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98f632-b34c-4761-9352-a7da7100b074 admin admin] PATH_INFO: `/v3/projects/fd8566fb1bf64d0aa70474541ee3c65f/users/36ece3221ac445f380520f20e504ce55/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.430845 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98f632-b34c-4761-9352-a7da7100b074 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8566fb1bf64d0aa70474541ee3c65f, user_id=36ece3221ac445f380520f20e504ce55, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.433557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b98f632-b34c-4761-9352-a7da7100b074 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.446798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1397/2812] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:55 2022] PUT /identity/v3/projects/fd8566fb1bf64d0aa70474541ee3c65f/users/36ece3221ac445f380520f20e504ce55/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:55.458179 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a008d-fcd1-4078-9e3a-27bce4f3e8ea None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.458467 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a008d-fcd1-4078-9e3a-27bce4f3e8ea None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.458748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a008d-fcd1-4078-9e3a-27bce4f3e8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.495510 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-0c9a008d-fcd1-4078-9e3a-27bce4f3e8ea None None] MFA Rules not processed for user `36ece3221ac445f380520f20e504ce55`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:55.496772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0c9a008d-fcd1-4078-9e3a-27bce4f3e8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:55.564719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1416/2813] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:55.569256 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98f632-b34c-4761-9352-a7da7100b074 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.633975 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b98f632-b34c-4761-9352-a7da7100b074 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.639064 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305681ef-a1c1-41cb-9f14-2963f44a2c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.639679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305681ef-a1c1-41cb-9f14-2963f44a2c92 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.640083 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305681ef-a1c1-41cb-9f14-2963f44a2c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.640244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305681ef-a1c1-41cb-9f14-2963f44a2c92 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.640885 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305681ef-a1c1-41cb-9f14-2963f44a2c92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.642837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305681ef-a1c1-41cb-9f14-2963f44a2c92 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.674383 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1398/2814] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:55 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:55.675477 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a008d-fcd1-4078-9e3a-27bce4f3e8ea None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.686947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a008d-fcd1-4078-9e3a-27bce4f3e8ea None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.749152 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264eb70-29fd-4c01-9a75-2d685ce84da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.749695 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264eb70-29fd-4c01-9a75-2d685ce84da7 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.750202 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264eb70-29fd-4c01-9a75-2d685ce84da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.750488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264eb70-29fd-4c01-9a75-2d685ce84da7 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.751141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264eb70-29fd-4c01-9a75-2d685ce84da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.753807 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264eb70-29fd-4c01-9a75-2d685ce84da7 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.794607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1417/2815] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:55 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:55:55.798735 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305681ef-a1c1-41cb-9f14-2963f44a2c92 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.809634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305681ef-a1c1-41cb-9f14-2963f44a2c92 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.814699 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cb3af-bae6-48b1-ae01-fadb2a2cf851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.815339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cb3af-bae6-48b1-ae01-fadb2a2cf851 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.815619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cb3af-bae6-48b1-ae01-fadb2a2cf851 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.816014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343cb3af-bae6-48b1-ae01-fadb2a2cf851 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.816791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cb3af-bae6-48b1-ae01-fadb2a2cf851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.818500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343cb3af-bae6-48b1-ae01-fadb2a2cf851 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.837373 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1399/2816] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:55.838612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264eb70-29fd-4c01-9a75-2d685ce84da7 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.848794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264eb70-29fd-4c01-9a75-2d685ce84da7 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.854278 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7103eae4-f3f5-44bd-af14-3893e9173f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.854874 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103eae4-f3f5-44bd-af14-3893e9173f75 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.855155 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103eae4-f3f5-44bd-af14-3893e9173f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.855431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103eae4-f3f5-44bd-af14-3893e9173f75 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.856068 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103eae4-f3f5-44bd-af14-3893e9173f75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.857692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7103eae4-f3f5-44bd-af14-3893e9173f75 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.871825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1418/2817] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:55.873715 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cb3af-bae6-48b1-ae01-fadb2a2cf851 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:55.887146 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343cb3af-bae6-48b1-ae01-fadb2a2cf851 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:55.894072 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9491eb4-cc90-4613-be4d-00dede9de9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:55.895095 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9491eb4-cc90-4613-be4d-00dede9de9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.895431 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9491eb4-cc90-4613-be4d-00dede9de9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.895720 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9491eb4-cc90-4613-be4d-00dede9de9c4 admin admin] PATH_INFO: `/v3/projects/a6aa42e3e8eb4238b8dbf51a1c097310/users/423c85e33aab45919284a9a665b9ad5c/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.912216 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9491eb4-cc90-4613-be4d-00dede9de9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6aa42e3e8eb4238b8dbf51a1c097310, user_id=423c85e33aab45919284a9a665b9ad5c, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:55.915432 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9491eb4-cc90-4613-be4d-00dede9de9c4 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:55.928764 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1400/2818] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:55 2022] PUT /identity/v3/projects/a6aa42e3e8eb4238b8dbf51a1c097310/users/423c85e33aab45919284a9a665b9ad5c/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:55.939548 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe15b3-a1a7-4df9-9a13-a00eb0993811 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:55.939835 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe15b3-a1a7-4df9-9a13-a00eb0993811 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:55.940236 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fe15b3-a1a7-4df9-9a13-a00eb0993811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:55.968012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-23fe15b3-a1a7-4df9-9a13-a00eb0993811 None None] MFA Rules not processed for user `423c85e33aab45919284a9a665b9ad5c`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:55.969230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-23fe15b3-a1a7-4df9-9a13-a00eb0993811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:55.995198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:56.036455 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1419/2819] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:55 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:56.042001 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9491eb4-cc90-4613-be4d-00dede9de9c4 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:56.107010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9491eb4-cc90-4613-be4d-00dede9de9c4 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:56.111791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e8717-689b-4db4-828b-e9a0d4570fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:56.112410 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e8717-689b-4db4-828b-e9a0d4570fc4 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:56.112696 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e8717-689b-4db4-828b-e9a0d4570fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:56.112979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3e8717-689b-4db4-828b-e9a0d4570fc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:56.113651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e8717-689b-4db4-828b-e9a0d4570fc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:56.115746 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3e8717-689b-4db4-828b-e9a0d4570fc4 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:56.148806 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1401/2820] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:56 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:56.153800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe15b3-a1a7-4df9-9a13-a00eb0993811 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:56.164405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fe15b3-a1a7-4df9-9a13-a00eb0993811 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:56.219707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15f7c6-457c-4a63-9065-acdb81317200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:56.220310 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f7c6-457c-4a63-9065-acdb81317200 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:56.220596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f7c6-457c-4a63-9065-acdb81317200 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:56.220871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a15f7c6-457c-4a63-9065-acdb81317200 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:56.221528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15f7c6-457c-4a63-9065-acdb81317200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:56.223431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a15f7c6-457c-4a63-9065-acdb81317200 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:56.245234 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1420/2821] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:56 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:56.249199 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e8717-689b-4db4-828b-e9a0d4570fc4 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:56.259475 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3e8717-689b-4db4-828b-e9a0d4570fc4 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:56.264183 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e990ed-fa85-42c4-952e-78f5a549b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:56.264780 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e990ed-fa85-42c4-952e-78f5a549b313 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:56.265058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e990ed-fa85-42c4-952e-78f5a549b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:56.265333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e990ed-fa85-42c4-952e-78f5a549b313 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:56.266004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e990ed-fa85-42c4-952e-78f5a549b313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:56.267600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e990ed-fa85-42c4-952e-78f5a549b313 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:56.278372 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1402/2822] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:56.282357 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15f7c6-457c-4a63-9065-acdb81317200 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:56.292795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a15f7c6-457c-4a63-9065-acdb81317200 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:56.297637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2b3c9-09d4-41fe-adcc-0810dd4ce26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:56.298290 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2b3c9-09d4-41fe-adcc-0810dd4ce26b admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:56.298572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2b3c9-09d4-41fe-adcc-0810dd4ce26b admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:56.298849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2b3c9-09d4-41fe-adcc-0810dd4ce26b admin admin] PATH_INFO: `/v3/projects/b2d5b30f019b4f119bc0de4cea46e1ce/users/200bb9f32f60421ab8915d4e672af21c/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:56.315025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2b3c9-09d4-41fe-adcc-0810dd4ce26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d5b30f019b4f119bc0de4cea46e1ce, user_id=200bb9f32f60421ab8915d4e672af21c, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:56.318918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa2b3c9-09d4-41fe-adcc-0810dd4ce26b admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:56.332245 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1421/2823] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:56 2022] PUT /identity/v3/projects/b2d5b30f019b4f119bc0de4cea46e1ce/users/200bb9f32f60421ab8915d4e672af21c/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:56.336429 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e990ed-fa85-42c4-952e-78f5a549b313 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:56.342059 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:56.348348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e990ed-fa85-42c4-952e-78f5a549b313 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:56.403906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365d3491-8e95-4cee-85a6-7310e2a2b60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:56.404509 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d3491-8e95-4cee-85a6-7310e2a2b60e admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:56.404790 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d3491-8e95-4cee-85a6-7310e2a2b60e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:56.405088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365d3491-8e95-4cee-85a6-7310e2a2b60e admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:56.405758 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d3491-8e95-4cee-85a6-7310e2a2b60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:56.407359 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365d3491-8e95-4cee-85a6-7310e2a2b60e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:56.420664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1403/2824] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:56.421672 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2b3c9-09d4-41fe-adcc-0810dd4ce26b admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:56.435473 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2b3c9-09d4-41fe-adcc-0810dd4ce26b admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:56.441593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d8db-aba6-42d5-b400-4b05349dd820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:56.442605 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d8db-aba6-42d5-b400-4b05349dd820 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:56.443113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d8db-aba6-42d5-b400-4b05349dd820 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:56.443584 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac6d8db-aba6-42d5-b400-4b05349dd820 admin admin] PATH_INFO: `/v3/projects/b2d5b30f019b4f119bc0de4cea46e1ce/users/200bb9f32f60421ab8915d4e672af21c/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:56.446637 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6d8db-aba6-42d5-b400-4b05349dd820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2d5b30f019b4f119bc0de4cea46e1ce, user_id=200bb9f32f60421ab8915d4e672af21c, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:56.449287 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac6d8db-aba6-42d5-b400-4b05349dd820 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:56.460062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1422/2825] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:56 2022] PUT /identity/v3/projects/b2d5b30f019b4f119bc0de4cea46e1ce/users/200bb9f32f60421ab8915d4e672af21c/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:56.471052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82daba9-38dc-41d2-96b9-fd88d8c44c66 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:56.471341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82daba9-38dc-41d2-96b9-fd88d8c44c66 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:56.471619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82daba9-38dc-41d2-96b9-fd88d8c44c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:56.500548 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f82daba9-38dc-41d2-96b9-fd88d8c44c66 None None] MFA Rules not processed for user `200bb9f32f60421ab8915d4e672af21c`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:56.501784 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f82daba9-38dc-41d2-96b9-fd88d8c44c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:56.568397 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1404/2826] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:56.579639 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d8db-aba6-42d5-b400-4b05349dd820 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:56.581383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-8ac6d8db-aba6-42d5-b400-4b05349dd820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:56.640097 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac6d8db-aba6-42d5-b400-4b05349dd820 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:56.643688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabe2b6-580b-47b3-867d-35d978662127 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:56.644286 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabe2b6-580b-47b3-867d-35d978662127 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:56.644562 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabe2b6-580b-47b3-867d-35d978662127 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:56.644834 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aabe2b6-580b-47b3-867d-35d978662127 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:56.676985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:56.702084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabe2b6-580b-47b3-867d-35d978662127 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:56.703396 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aabe2b6-580b-47b3-867d-35d978662127 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:56.713049 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1423/2827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:58.218258 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82daba9-38dc-41d2-96b9-fd88d8c44c66 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:58.227880 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82daba9-38dc-41d2-96b9-fd88d8c44c66 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:58.231913 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01abac-308a-47b0-b44f-c8d928f8bc6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:58.232622 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01abac-308a-47b0-b44f-c8d928f8bc6e service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:58.232973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01abac-308a-47b0-b44f-c8d928f8bc6e service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:58.233260 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01abac-308a-47b0-b44f-c8d928f8bc6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:58.244498 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabe2b6-580b-47b3-867d-35d978662127 service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:58.245902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9aabe2b6-580b-47b3-867d-35d978662127 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:58.290192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01abac-308a-47b0-b44f-c8d928f8bc6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:58.291643 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01abac-308a-47b0-b44f-c8d928f8bc6e service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:58.300467 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1405/2828] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:58.310453 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aabe2b6-580b-47b3-867d-35d978662127 service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:58.315136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:58.315769 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:58.316048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:58.316323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] PATH_INFO: `/v3/users/31349e1d7d614e2585cc9629a9baa702` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:58.317555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31349e1d7d614e2585cc9629a9baa702)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:58.319471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:58.369941 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31349e1d7d614e2585cc9629a9baa702'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.377710 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31349e1d7d614e2585cc9629a9baa702'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.378346 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31349e1d7d614e2585cc9629a9baa702'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.386772 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31349e1d7d614e2585cc9629a9baa702'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.398777 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31349e1d7d614e2585cc9629a9baa702'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.404762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1424/2829] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:58 2022] DELETE /identity/v3/users/31349e1d7d614e2585cc9629a9baa702 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:58.409749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b542f7-cece-4019-9802-7909f58315f8 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:58.410300 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b542f7-cece-4019-9802-7909f58315f8 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:58.410648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b542f7-cece-4019-9802-7909f58315f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:58.436296 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-08b542f7-cece-4019-9802-7909f58315f8 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:58.437544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-08b542f7-cece-4019-9802-7909f58315f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:58.455220 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:58.498805 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1406/2830] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:58.509433 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:58.510945 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:58.572500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7154a0-dfaa-4d89-88b9-1ecf7c58f3f8 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:58.576299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a0c70-c919-40e6-8f9a-23e29eae7f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:58.576913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a0c70-c919-40e6-8f9a-23e29eae7f60 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:58.577194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a0c70-c919-40e6-8f9a-23e29eae7f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:58.577511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7a0c70-c919-40e6-8f9a-23e29eae7f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:58.585509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:58.588417 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a0c70-c919-40e6-8f9a-23e29eae7f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:58.590697 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7a0c70-c919-40e6-8f9a-23e29eae7f60 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:58.603953 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1425/2831] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:58.874387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b542f7-cece-4019-9802-7909f58315f8 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:58.876068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-08b542f7-cece-4019-9802-7909f58315f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:58.885060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a0c70-c919-40e6-8f9a-23e29eae7f60 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:58.886670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-1b7a0c70-c919-40e6-8f9a-23e29eae7f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:58.904096 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7a0c70-c919-40e6-8f9a-23e29eae7f60 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:58.909820 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:58.910629 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:58.910742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:58.910992 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] PATH_INFO: `/v3/projects/c278b6143e2245ac82ab74282fed0b7f` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:58.912803 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c278b6143e2245ac82ab74282fed0b7f)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:58.914728 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:58.943731 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b542f7-cece-4019-9802-7909f58315f8 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:58.947687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db623a-896d-4ae3-a415-388fe1bc9622 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:58.948310 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db623a-896d-4ae3-a415-388fe1bc9622 service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:58.948594 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db623a-896d-4ae3-a415-388fe1bc9622 service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:58.948892 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9db623a-896d-4ae3-a415-388fe1bc9622 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:58.950679 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f9db623a-896d-4ae3-a415-388fe1bc9622 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:58.965062 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c278b6143e2245ac82ab74282fed0b7f', 'request_id': 'req-593d5e47-a652-4908-b3af-edf3aae6e9c8'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.973800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c278b6143e2245ac82ab74282fed0b7f', 'request_id': 'req-593d5e47-a652-4908-b3af-edf3aae6e9c8'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.980335 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c278b6143e2245ac82ab74282fed0b7f', 'request_id': 'req-593d5e47-a652-4908-b3af-edf3aae6e9c8'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.992180 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] The token cache is being invalidate because project c278b6143e2245ac82ab74282fed0b7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:58.992946 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.993841 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:58.996342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1426/2832] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:58 2022] DELETE /identity/v3/projects/c278b6143e2245ac82ab74282fed0b7f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:59.000001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:59.001325 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:59.015454 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db623a-896d-4ae3-a415-388fe1bc9622 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:59.016968 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9db623a-896d-4ae3-a415-388fe1bc9622 service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:59.027237 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1407/2833] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:55:58 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:55:59.065687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d5e47-a652-4908-b3af-edf3aae6e9c8 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:59.070504 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:59.071160 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.071443 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.071824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] PATH_INFO: `/v3/users/ad33ea19c5b1495cbdf364173b790800` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:59.073065 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad33ea19c5b1495cbdf364173b790800)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:59.075614 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:59.134811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad33ea19c5b1495cbdf364173b790800'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.142935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad33ea19c5b1495cbdf364173b790800'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.143560 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad33ea19c5b1495cbdf364173b790800'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.151193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad33ea19c5b1495cbdf364173b790800'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.164261 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-91f4d529-692e-4f3c-a2c3-248975e82525 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad33ea19c5b1495cbdf364173b790800'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.166967 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:59.172928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1427/2834] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:55:58 2022] DELETE /identity/v3/users/ad33ea19c5b1495cbdf364173b790800 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:55:59.445713 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db623a-896d-4ae3-a415-388fe1bc9622 service cinder] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:59.462781 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9db623a-896d-4ae3-a415-388fe1bc9622 service cinder] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:59.519844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:59.520479 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.520761 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.521035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] PATH_INFO: `/v3/projects/c87d1f9506ce401aa88e5cf2fbdb8e1d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:59.522187 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c87d1f9506ce401aa88e5cf2fbdb8e1d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:59.524103 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:59.539861 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=100 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:55:59.569648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c87d1f9506ce401aa88e5cf2fbdb8e1d', 'request_id': 'req-41f4bb3a-64d3-42b3-8da6-0c814219662e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.578050 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c87d1f9506ce401aa88e5cf2fbdb8e1d', 'request_id': 'req-41f4bb3a-64d3-42b3-8da6-0c814219662e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.583593 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c87d1f9506ce401aa88e5cf2fbdb8e1d', 'request_id': 'req-41f4bb3a-64d3-42b3-8da6-0c814219662e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.595482 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] The token cache is being invalidate because project c87d1f9506ce401aa88e5cf2fbdb8e1d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:55:59.595886 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.596524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-41f4bb3a-64d3-42b3-8da6-0c814219662e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:55:59.598299 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1408/2835] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:55:59 2022] DELETE /identity/v3/projects/c87d1f9506ce401aa88e5cf2fbdb8e1d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:55:59.603164 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4de93-07d6-46ca-b00a-0325dd8bda80 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.603644 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4de93-07d6-46ca-b00a-0325dd8bda80 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.603759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4de93-07d6-46ca-b00a-0325dd8bda80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:59.623048 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-fec4de93-07d6-46ca-b00a-0325dd8bda80 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:59.624239 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fec4de93-07d6-46ca-b00a-0325dd8bda80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:59.682840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1428/2836] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:59.690716 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b695eb4-716e-42b8-8abf-908ae12b7b56 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.691020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b695eb4-716e-42b8-8abf-908ae12b7b56 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.691293 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b695eb4-716e-42b8-8abf-908ae12b7b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:59.712171 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-8b695eb4-716e-42b8-8abf-908ae12b7b56 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:55:59.713365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-8b695eb4-716e-42b8-8abf-908ae12b7b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:55:59.721627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1409/2837] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:55:59.725795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4de93-07d6-46ca-b00a-0325dd8bda80 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:59.735425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4de93-07d6-46ca-b00a-0325dd8bda80 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:59.739970 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f05af4-8787-4e18-86e5-ff4a9b669069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:59.740564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05af4-8787-4e18-86e5-ff4a9b669069 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.740844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05af4-8787-4e18-86e5-ff4a9b669069 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.741120 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f05af4-8787-4e18-86e5-ff4a9b669069 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:59.741808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f05af4-8787-4e18-86e5-ff4a9b669069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:55:59.742112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f05af4-8787-4e18-86e5-ff4a9b669069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:59.744249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f05af4-8787-4e18-86e5-ff4a9b669069 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:59.755630 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1429/2838] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:55:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:55:59.760403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b695eb4-716e-42b8-8abf-908ae12b7b56 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:59.769528 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b695eb4-716e-42b8-8abf-908ae12b7b56 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:59.775120 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f927-1256-46ae-ab82-5c5f535fbbb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:59.775723 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f927-1256-46ae-ab82-5c5f535fbbb2 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.776003 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f927-1256-46ae-ab82-5c5f535fbbb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.776276 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5102f927-1256-46ae-ab82-5c5f535fbbb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:59.776907 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f927-1256-46ae-ab82-5c5f535fbbb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:59.778837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5102f927-1256-46ae-ab82-5c5f535fbbb2 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:59.808566 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1410/2839] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:55:59 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:59.812823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f05af4-8787-4e18-86e5-ff4a9b669069 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:59.823512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f05af4-8787-4e18-86e5-ff4a9b669069 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:59.878057 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f22d76-eb5d-47fd-8403-a6b232e75317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:59.878659 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f22d76-eb5d-47fd-8403-a6b232e75317 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.878943 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f22d76-eb5d-47fd-8403-a6b232e75317 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.879228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f22d76-eb5d-47fd-8403-a6b232e75317 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:59.879855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f22d76-eb5d-47fd-8403-a6b232e75317 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:59.881814 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f22d76-eb5d-47fd-8403-a6b232e75317 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:59.903228 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1430/2840] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:55:59 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:55:59.908387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f927-1256-46ae-ab82-5c5f535fbbb2 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:59.919111 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5102f927-1256-46ae-ab82-5c5f535fbbb2 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:59.923796 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539c25-91be-4aa5-88b0-ed01a7f40559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:59.924396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539c25-91be-4aa5-88b0-ed01a7f40559 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.924675 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539c25-91be-4aa5-88b0-ed01a7f40559 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.924949 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de539c25-91be-4aa5-88b0-ed01a7f40559 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:59.925625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de539c25-91be-4aa5-88b0-ed01a7f40559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:59.927228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de539c25-91be-4aa5-88b0-ed01a7f40559 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:59.937545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1411/2841] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:55:59.941249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f22d76-eb5d-47fd-8403-a6b232e75317 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:59.951564 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f22d76-eb5d-47fd-8403-a6b232e75317 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:59.956176 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c1bf98-9a71-4b63-ae83-8c0f343c8c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:59.956766 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1bf98-9a71-4b63-ae83-8c0f343c8c6a admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.957047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1bf98-9a71-4b63-ae83-8c0f343c8c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.957324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c1bf98-9a71-4b63-ae83-8c0f343c8c6a admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:55:59.958001 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1bf98-9a71-4b63-ae83-8c0f343c8c6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:55:59.959575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c1bf98-9a71-4b63-ae83-8c0f343c8c6a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:55:59.971211 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1431/2842] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:55:59.975017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539c25-91be-4aa5-88b0-ed01a7f40559 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:55:59.984777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de539c25-91be-4aa5-88b0-ed01a7f40559 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:55:59.989387 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f3c28-f991-45f7-a949-bd1859d3626b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:55:59.990056 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f3c28-f991-45f7-a949-bd1859d3626b admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:55:59.990337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f3c28-f991-45f7-a949-bd1859d3626b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:55:59.990614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f3c28-f991-45f7-a949-bd1859d3626b admin admin] PATH_INFO: `/v3/projects/e725e488ad754320a1b1fe55af65695d/users/e62dbd42ce094ebdae469ddec5e16b28/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.005204 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f3c28-f991-45f7-a949-bd1859d3626b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e725e488ad754320a1b1fe55af65695d, user_id=e62dbd42ce094ebdae469ddec5e16b28, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.007915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f3c28-f991-45f7-a949-bd1859d3626b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.021325 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1412/2843] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:55:59 2022] PUT /identity/v3/projects/e725e488ad754320a1b1fe55af65695d/users/e62dbd42ce094ebdae469ddec5e16b28/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:00.032434 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece008c0-4205-4bc8-b375-81f42e3c0d61 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.032715 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece008c0-4205-4bc8-b375-81f42e3c0d61 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.032986 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece008c0-4205-4bc8-b375-81f42e3c0d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.060735 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ece008c0-4205-4bc8-b375-81f42e3c0d61 None None] MFA Rules not processed for user `e62dbd42ce094ebdae469ddec5e16b28`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:00.061955 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ece008c0-4205-4bc8-b375-81f42e3c0d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:00.113556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:00.127403 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1432/2844] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:00.131808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f3c28-f991-45f7-a949-bd1859d3626b admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.204370 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f3c28-f991-45f7-a949-bd1859d3626b admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.209140 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c9711-3f82-4bc7-b011-68f2a81c4d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.209920 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c9711-3f82-4bc7-b011-68f2a81c4d75 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.210200 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c9711-3f82-4bc7-b011-68f2a81c4d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.210480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c9711-3f82-4bc7-b011-68f2a81c4d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.211402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c9711-3f82-4bc7-b011-68f2a81c4d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.213302 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c9711-3f82-4bc7-b011-68f2a81c4d75 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.242783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1413/2845] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:56:00 2022] POST /identity/v3/projects => generated 377 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:00.244571 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece008c0-4205-4bc8-b375-81f42e3c0d61 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.255533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece008c0-4205-4bc8-b375-81f42e3c0d61 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.315995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c59af-2170-4d0c-9abd-8cdc64e9167c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.316749 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c59af-2170-4d0c-9abd-8cdc64e9167c admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.317081 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c59af-2170-4d0c-9abd-8cdc64e9167c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.317441 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c59af-2170-4d0c-9abd-8cdc64e9167c admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.318151 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c59af-2170-4d0c-9abd-8cdc64e9167c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.320225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c59af-2170-4d0c-9abd-8cdc64e9167c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.341762 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1433/2846] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:56:00 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:00.345337 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c9711-3f82-4bc7-b011-68f2a81c4d75 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.356091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c9711-3f82-4bc7-b011-68f2a81c4d75 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.361464 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a955cc-4c39-47de-ae1a-5315dc3c9121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.362073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a955cc-4c39-47de-ae1a-5315dc3c9121 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.362348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a955cc-4c39-47de-ae1a-5315dc3c9121 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.362619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a955cc-4c39-47de-ae1a-5315dc3c9121 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.363279 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a955cc-4c39-47de-ae1a-5315dc3c9121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.365634 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a955cc-4c39-47de-ae1a-5315dc3c9121 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.382399 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1414/2847] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:56:00.390413 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c59af-2170-4d0c-9abd-8cdc64e9167c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.401083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c59af-2170-4d0c-9abd-8cdc64e9167c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.405760 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7701165-1af9-430f-8c09-c5eee646e432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.406359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7701165-1af9-430f-8c09-c5eee646e432 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.406634 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7701165-1af9-430f-8c09-c5eee646e432 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.406905 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7701165-1af9-430f-8c09-c5eee646e432 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.407547 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7701165-1af9-430f-8c09-c5eee646e432 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.409178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7701165-1af9-430f-8c09-c5eee646e432 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.437426 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1434/2848] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:56:00.437795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a955cc-4c39-47de-ae1a-5315dc3c9121 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.441927 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a955cc-4c39-47de-ae1a-5315dc3c9121 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.446590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb02d6b-36cd-4748-ad29-af06ee6a08ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.447249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb02d6b-36cd-4748-ad29-af06ee6a08ef admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.447524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb02d6b-36cd-4748-ad29-af06ee6a08ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.447788 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb02d6b-36cd-4748-ad29-af06ee6a08ef admin admin] PATH_INFO: `/v3/projects/53e7f59c44a243a7a9e1cb3970ca36e2/users/d385bc0b19e2462683b7219231b86f29/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.459227 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:00.464848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb02d6b-36cd-4748-ad29-af06ee6a08ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e7f59c44a243a7a9e1cb3970ca36e2, user_id=d385bc0b19e2462683b7219231b86f29, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.467983 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb02d6b-36cd-4748-ad29-af06ee6a08ef admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.485519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1415/2849] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:56:00 2022] PUT /identity/v3/projects/53e7f59c44a243a7a9e1cb3970ca36e2/users/d385bc0b19e2462683b7219231b86f29/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:56:00.497619 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686623e-404b-4028-bbe4-3e21ba022a9b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.497912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686623e-404b-4028-bbe4-3e21ba022a9b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.498193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686623e-404b-4028-bbe4-3e21ba022a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.527601 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-f686623e-404b-4028-bbe4-3e21ba022a9b None None] MFA Rules not processed for user `d385bc0b19e2462683b7219231b86f29`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:00.528831 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-f686623e-404b-4028-bbe4-3e21ba022a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:00.592930 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1435/2850] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:00.597430 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb02d6b-36cd-4748-ad29-af06ee6a08ef admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.662251 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb02d6b-36cd-4748-ad29-af06ee6a08ef admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.667549 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21797cba-769b-46bf-9f70-2438f7d8b527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.668156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21797cba-769b-46bf-9f70-2438f7d8b527 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.668551 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21797cba-769b-46bf-9f70-2438f7d8b527 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.668831 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21797cba-769b-46bf-9f70-2438f7d8b527 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.669484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21797cba-769b-46bf-9f70-2438f7d8b527 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.671396 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21797cba-769b-46bf-9f70-2438f7d8b527 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.697843 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1416/2851] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:56:00 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:00.702071 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686623e-404b-4028-bbe4-3e21ba022a9b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.713454 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686623e-404b-4028-bbe4-3e21ba022a9b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.767327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472f20-3f88-4ff1-b093-733836299647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.767926 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472f20-3f88-4ff1-b093-733836299647 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.768205 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472f20-3f88-4ff1-b093-733836299647 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.768476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b472f20-3f88-4ff1-b093-733836299647 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.769105 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b472f20-3f88-4ff1-b093-733836299647 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.771056 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b472f20-3f88-4ff1-b093-733836299647 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.780482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:00.793625 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1436/2852] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:56:00 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:00.798624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21797cba-769b-46bf-9f70-2438f7d8b527 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.810181 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21797cba-769b-46bf-9f70-2438f7d8b527 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.814846 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7331210-1734-4b89-913d-a92fe8ddd015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.815441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7331210-1734-4b89-913d-a92fe8ddd015 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.815714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7331210-1734-4b89-913d-a92fe8ddd015 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.815984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7331210-1734-4b89-913d-a92fe8ddd015 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.816651 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7331210-1734-4b89-913d-a92fe8ddd015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.818313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7331210-1734-4b89-913d-a92fe8ddd015 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.829110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1417/2853] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:56:00.833668 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472f20-3f88-4ff1-b093-733836299647 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.844390 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b472f20-3f88-4ff1-b093-733836299647 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.848958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c96496-1ed4-401c-917f-16bb382a79f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.849635 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c96496-1ed4-401c-917f-16bb382a79f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.849918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c96496-1ed4-401c-917f-16bb382a79f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.850193 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c96496-1ed4-401c-917f-16bb382a79f4 admin admin] PATH_INFO: `/v3/projects/78d5dd7959d64d59bff5261af8e19c69/users/92c0967326cb4661b8df91f5eedff526/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.864416 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c96496-1ed4-401c-917f-16bb382a79f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d5dd7959d64d59bff5261af8e19c69, user_id=92c0967326cb4661b8df91f5eedff526, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.867107 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c96496-1ed4-401c-917f-16bb382a79f4 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.879487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1437/2854] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:56:00 2022] PUT /identity/v3/projects/78d5dd7959d64d59bff5261af8e19c69/users/92c0967326cb4661b8df91f5eedff526/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:56:00.883415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7331210-1734-4b89-913d-a92fe8ddd015 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.893618 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7331210-1734-4b89-913d-a92fe8ddd015 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.948102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c5d54e-7865-4a78-aa79-89bbc03b961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.948631 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5d54e-7865-4a78-aa79-89bbc03b961b admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.948910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5d54e-7865-4a78-aa79-89bbc03b961b admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.949182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c5d54e-7865-4a78-aa79-89bbc03b961b admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.949850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5d54e-7865-4a78-aa79-89bbc03b961b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.951440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c5d54e-7865-4a78-aa79-89bbc03b961b admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.960942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1418/2855] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:56:00.965702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c96496-1ed4-401c-917f-16bb382a79f4 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:00.975707 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c96496-1ed4-401c-917f-16bb382a79f4 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:00.980303 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12cad-c22c-44e7-a889-745e886223f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:00.980940 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12cad-c22c-44e7-a889-745e886223f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:00.981222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12cad-c22c-44e7-a889-745e886223f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:00.981531 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c12cad-c22c-44e7-a889-745e886223f4 admin admin] PATH_INFO: `/v3/projects/78d5dd7959d64d59bff5261af8e19c69/users/92c0967326cb4661b8df91f5eedff526/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:00.983438 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c12cad-c22c-44e7-a889-745e886223f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78d5dd7959d64d59bff5261af8e19c69, user_id=92c0967326cb4661b8df91f5eedff526, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:00.986141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c12cad-c22c-44e7-a889-745e886223f4 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:00.996072 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1438/2856] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:56:00 2022] PUT /identity/v3/projects/78d5dd7959d64d59bff5261af8e19c69/users/92c0967326cb4661b8df91f5eedff526/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:01.005795 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeddbf1-871a-4a30-9287-05207ad5374d None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:01.006085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeddbf1-871a-4a30-9287-05207ad5374d None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:01.006407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeddbf1-871a-4a30-9287-05207ad5374d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:01.034716 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-cdeddbf1-871a-4a30-9287-05207ad5374d None None] MFA Rules not processed for user `92c0967326cb4661b8df91f5eedff526`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:01.035902 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-cdeddbf1-871a-4a30-9287-05207ad5374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:01.080154 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:01.103420 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1419/2857] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:56:01.116509 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12cad-c22c-44e7-a889-745e886223f4 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:01.118471 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-24c12cad-c22c-44e7-a889-745e886223f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:01.174952 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c12cad-c22c-44e7-a889-745e886223f4 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:01.178572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983781d6-1ab8-42a9-8ad2-75d567becc1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:01.179166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983781d6-1ab8-42a9-8ad2-75d567becc1c service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:01.179447 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983781d6-1ab8-42a9-8ad2-75d567becc1c service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:01.179721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983781d6-1ab8-42a9-8ad2-75d567becc1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:01.189002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983781d6-1ab8-42a9-8ad2-75d567becc1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:01.190457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983781d6-1ab8-42a9-8ad2-75d567becc1c service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:01.200407 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1439/2858] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:01.243544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeddbf1-871a-4a30-9287-05207ad5374d None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:01.244912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-cdeddbf1-871a-4a30-9287-05207ad5374d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:01.256807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeddbf1-871a-4a30-9287-05207ad5374d None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:01.261002 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5577b52-ed5e-4e22-9a57-4890245a1eed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:01.261640 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577b52-ed5e-4e22-9a57-4890245a1eed service cinder] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:01.261918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577b52-ed5e-4e22-9a57-4890245a1eed service cinder] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:01.262189 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5577b52-ed5e-4e22-9a57-4890245a1eed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:01.317560 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5577b52-ed5e-4e22-9a57-4890245a1eed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:01.319057 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5577b52-ed5e-4e22-9a57-4890245a1eed service cinder] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:01.328543 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1420/2859] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:02.930719 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983781d6-1ab8-42a9-8ad2-75d567becc1c service cinder] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:02.932132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-983781d6-1ab8-42a9-8ad2-75d567becc1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:02.998252 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983781d6-1ab8-42a9-8ad2-75d567becc1c service cinder] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:03.002925 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:03.003612 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:03.003954 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:03.004297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] PATH_INFO: `/v3/users/36ece3221ac445f380520f20e504ce55` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:03.005533 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ece3221ac445f380520f20e504ce55)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:03.007464 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:03.054842 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ece3221ac445f380520f20e504ce55'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.062271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ece3221ac445f380520f20e504ce55'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.063000 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ece3221ac445f380520f20e504ce55'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.067920 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:03.071617 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ece3221ac445f380520f20e504ce55'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.086259 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ece3221ac445f380520f20e504ce55'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.093195 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1440/2860] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:02 2022] DELETE /identity/v3/users/36ece3221ac445f380520f20e504ce55 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:03.098052 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfe3f2-9b11-4186-a887-614b4b30cb8c None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:03.098612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfe3f2-9b11-4186-a887-614b4b30cb8c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:03.098612 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcfe3f2-9b11-4186-a887-614b4b30cb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:03.120081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9fcfe3f2-9b11-4186-a887-614b4b30cb8c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:03.121480 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9fcfe3f2-9b11-4186-a887-614b4b30cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:03.182792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1421/2861] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:56:03.192277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:03.193646 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:03.254021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ee34f-6731-4970-bf0b-f018720510d6 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:03.257933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aba25-8d89-4168-85a6-50bfa28494e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:03.259047 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aba25-8d89-4168-85a6-50bfa28494e8 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:03.259349 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aba25-8d89-4168-85a6-50bfa28494e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:03.259596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367aba25-8d89-4168-85a6-50bfa28494e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:03.268844 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aba25-8d89-4168-85a6-50bfa28494e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:03.270294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367aba25-8d89-4168-85a6-50bfa28494e8 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:03.280148 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1441/2862] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:03.546740 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfe3f2-9b11-4186-a887-614b4b30cb8c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:03.548193 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9fcfe3f2-9b11-4186-a887-614b4b30cb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:03.560617 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcfe3f2-9b11-4186-a887-614b4b30cb8c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:03.565859 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:03.566502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:03.566778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:03.567084 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] PATH_INFO: `/v3/projects/fd8566fb1bf64d0aa70474541ee3c65f` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:03.568201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8566fb1bf64d0aa70474541ee3c65f)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:03.570290 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:03.621830 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8566fb1bf64d0aa70474541ee3c65f', 'request_id': 'req-efe734d8-9d59-4ebb-a77f-3602afe42be5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.628917 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8566fb1bf64d0aa70474541ee3c65f', 'request_id': 'req-efe734d8-9d59-4ebb-a77f-3602afe42be5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.635014 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8566fb1bf64d0aa70474541ee3c65f', 'request_id': 'req-efe734d8-9d59-4ebb-a77f-3602afe42be5'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.645767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] The token cache is being invalidate because project fd8566fb1bf64d0aa70474541ee3c65f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:03.646055 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.646680 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.648156 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1422/2863] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:03 2022] DELETE /identity/v3/projects/fd8566fb1bf64d0aa70474541ee3c65f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:03.652113 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aba25-8d89-4168-85a6-50bfa28494e8 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:03.661748 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367aba25-8d89-4168-85a6-50bfa28494e8 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:03.716628 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:03.717186 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:03.717512 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:03.717789 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] PATH_INFO: `/v3/users/423c85e33aab45919284a9a665b9ad5c` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:03.718914 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] RBAC: Authorizing `identity:delete_user(user_id=423c85e33aab45919284a9a665b9ad5c)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:03.720828 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:03.766051 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '423c85e33aab45919284a9a665b9ad5c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.774129 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '423c85e33aab45919284a9a665b9ad5c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.774733 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '423c85e33aab45919284a9a665b9ad5c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.781676 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '423c85e33aab45919284a9a665b9ad5c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.794084 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '423c85e33aab45919284a9a665b9ad5c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:03.795528 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:03.802496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1442/2864] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:03 2022] DELETE /identity/v3/users/423c85e33aab45919284a9a665b9ad5c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:04.070182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:04.071614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:04.084129 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe734d8-9d59-4ebb-a77f-3602afe42be5 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:04.087962 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:04.145160 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:04.145837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:04.146091 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:04.146362 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] PATH_INFO: `/v3/projects/a6aa42e3e8eb4238b8dbf51a1c097310` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:04.147490 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6aa42e3e8eb4238b8dbf51a1c097310)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:04.149390 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:04.197557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6aa42e3e8eb4238b8dbf51a1c097310', 'request_id': 'req-af35174b-fdb1-4a9c-b920-88d72e9fde97'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.205102 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6aa42e3e8eb4238b8dbf51a1c097310', 'request_id': 'req-af35174b-fdb1-4a9c-b920-88d72e9fde97'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.211314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6aa42e3e8eb4238b8dbf51a1c097310', 'request_id': 'req-af35174b-fdb1-4a9c-b920-88d72e9fde97'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.218654 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:04.220239 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:04.223406 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] The token cache is being invalidate because project a6aa42e3e8eb4238b8dbf51a1c097310 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:04.223698 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.224368 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.225881 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1423/2865] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:04 2022] DELETE /identity/v3/projects/a6aa42e3e8eb4238b8dbf51a1c097310 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:04.230898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:04.232401 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:04.233385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcca32ec-764e-4112-8b10-855bfb638658 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:04.290482 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:04.291112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:04.291394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:04.291669 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] PATH_INFO: `/v3/users/e62dbd42ce094ebdae469ddec5e16b28` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:04.292786 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e62dbd42ce094ebdae469ddec5e16b28)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:04.294697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35174b-fdb1-4a9c-b920-88d72e9fde97 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:04.294846 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:04.299351 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:04.299972 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:04.300249 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:04.300519 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] PATH_INFO: `/v3/users/200bb9f32f60421ab8915d4e672af21c` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:04.301672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] RBAC: Authorizing `identity:delete_user(user_id=200bb9f32f60421ab8915d4e672af21c)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:04.303574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:04.341235 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e62dbd42ce094ebdae469ddec5e16b28'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.345321 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:04.348344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e62dbd42ce094ebdae469ddec5e16b28'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.348969 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e62dbd42ce094ebdae469ddec5e16b28'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.354088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '200bb9f32f60421ab8915d4e672af21c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.357431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e62dbd42ce094ebdae469ddec5e16b28'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.361261 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '200bb9f32f60421ab8915d4e672af21c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.361948 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '200bb9f32f60421ab8915d4e672af21c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.369658 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-53ad0be6-7b22-459c-99de-7c757c3467e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e62dbd42ce094ebdae469ddec5e16b28'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.374240 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '200bb9f32f60421ab8915d4e672af21c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.375607 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1443/2866] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:04 2022] DELETE /identity/v3/users/e62dbd42ce094ebdae469ddec5e16b28 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:56:04.379858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8c43a-bf4a-48a8-8b61-45c2c51aac6b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:04.380141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8c43a-bf4a-48a8-8b61-45c2c51aac6b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:04.380419 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8c43a-bf4a-48a8-8b61-45c2c51aac6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:04.381639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '200bb9f32f60421ab8915d4e672af21c'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.387794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1424/2867] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:04 2022] DELETE /identity/v3/users/200bb9f32f60421ab8915d4e672af21c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:56:04.403024 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-4dc8c43a-bf4a-48a8-8b61-45c2c51aac6b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:04.404248 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4dc8c43a-bf4a-48a8-8b61-45c2c51aac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:04.472339 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1444/2868] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:56:04.482660 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:04.484155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:04.547128 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922f7b54-31cc-463f-a897-759d76372fcc admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:04.550997 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da32894-c009-4460-bb3b-daec57676ba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:04.551621 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da32894-c009-4460-bb3b-daec57676ba3 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:04.551905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da32894-c009-4460-bb3b-daec57676ba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:04.552184 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da32894-c009-4460-bb3b-daec57676ba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:04.562077 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da32894-c009-4460-bb3b-daec57676ba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:04.563535 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da32894-c009-4460-bb3b-daec57676ba3 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:04.573910 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1425/2869] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:04.729326 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8c43a-bf4a-48a8-8b61-45c2c51aac6b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:04.730815 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-4dc8c43a-bf4a-48a8-8b61-45c2c51aac6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:04.746200 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8c43a-bf4a-48a8-8b61-45c2c51aac6b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:04.751519 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:04.752166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:04.752500 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:04.752906 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] PATH_INFO: `/v3/projects/b2d5b30f019b4f119bc0de4cea46e1ce` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:04.754064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2d5b30f019b4f119bc0de4cea46e1ce)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:04.756222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:04.769627 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:04.817544 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2d5b30f019b4f119bc0de4cea46e1ce', 'request_id': 'req-d12b08ed-28cf-4a98-8371-aebd48e4a90d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.825767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2d5b30f019b4f119bc0de4cea46e1ce', 'request_id': 'req-d12b08ed-28cf-4a98-8371-aebd48e4a90d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.831933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2d5b30f019b4f119bc0de4cea46e1ce', 'request_id': 'req-d12b08ed-28cf-4a98-8371-aebd48e4a90d'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.844289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] The token cache is being invalidate because project b2d5b30f019b4f119bc0de4cea46e1ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:04.844811 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.845537 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:04.847364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1445/2870] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:04 2022] DELETE /identity/v3/projects/b2d5b30f019b4f119bc0de4cea46e1ce => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:56:04.919127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da32894-c009-4460-bb3b-daec57676ba3 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:04.920656 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-2da32894-c009-4460-bb3b-daec57676ba3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:04.936658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da32894-c009-4460-bb3b-daec57676ba3 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:04.999933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:05.000591 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:05.000870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:05.001148 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] PATH_INFO: `/v3/projects/e725e488ad754320a1b1fe55af65695d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:05.002374 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] RBAC: Authorizing `identity:delete_project(project_id=e725e488ad754320a1b1fe55af65695d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:05.004346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:05.056914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e725e488ad754320a1b1fe55af65695d', 'request_id': 'req-632ee823-8a19-479c-94c2-7826cecc9fce'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.065524 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e725e488ad754320a1b1fe55af65695d', 'request_id': 'req-632ee823-8a19-479c-94c2-7826cecc9fce'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.069869 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:05.072853 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e725e488ad754320a1b1fe55af65695d', 'request_id': 'req-632ee823-8a19-479c-94c2-7826cecc9fce'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.086870 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] The token cache is being invalidate because project e725e488ad754320a1b1fe55af65695d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:05.087161 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.087825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.089339 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1426/2871] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:04 2022] DELETE /identity/v3/projects/e725e488ad754320a1b1fe55af65695d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:05.093567 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:05.095174 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:05.108708 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12b08ed-28cf-4a98-8371-aebd48e4a90d admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:05.166063 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:05.166699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:05.166975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:05.167246 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] PATH_INFO: `/v3/users/d385bc0b19e2462683b7219231b86f29` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:05.168359 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d385bc0b19e2462683b7219231b86f29)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:05.170323 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:05.219753 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd385bc0b19e2462683b7219231b86f29'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.226344 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd385bc0b19e2462683b7219231b86f29'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.226958 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd385bc0b19e2462683b7219231b86f29'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.233912 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd385bc0b19e2462683b7219231b86f29'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.246005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd385bc0b19e2462683b7219231b86f29'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.251767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1446/2872] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:05 2022] DELETE /identity/v3/users/d385bc0b19e2462683b7219231b86f29 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:05.521283 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:05.522772 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:05.535505 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632ee823-8a19-479c-94c2-7826cecc9fce admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:05.592358 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:05.592993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:05.593274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:05.593656 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] PATH_INFO: `/v3/projects/53e7f59c44a243a7a9e1cb3970ca36e2` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:05.594773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e7f59c44a243a7a9e1cb3970ca36e2)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:05.596742 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:05.642954 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e7f59c44a243a7a9e1cb3970ca36e2', 'request_id': 'req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.650127 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e7f59c44a243a7a9e1cb3970ca36e2', 'request_id': 'req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.655734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e7f59c44a243a7a9e1cb3970ca36e2', 'request_id': 'req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.667023 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] The token cache is being invalidate because project 53e7f59c44a243a7a9e1cb3970ca36e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:05.667313 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.667955 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.669458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1427/2873] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:05 2022] DELETE /identity/v3/projects/53e7f59c44a243a7a9e1cb3970ca36e2 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:05.673451 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:05.674871 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:05.688444 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46c624b-b354-4669-b7a1-2987cead748f admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:05.704521 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:05.746253 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:05.746887 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:05.747166 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:05.747439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] PATH_INFO: `/v3/users/92c0967326cb4661b8df91f5eedff526` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:05.748543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92c0967326cb4661b8df91f5eedff526)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:05.750513 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:05.794858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92c0967326cb4661b8df91f5eedff526'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.801726 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92c0967326cb4661b8df91f5eedff526'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.802460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92c0967326cb4661b8df91f5eedff526'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.810285 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92c0967326cb4661b8df91f5eedff526'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.823292 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-efbfc87c-3073-45e2-8fd1-12451a49f450 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92c0967326cb4661b8df91f5eedff526'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:05.829383 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1447/2874] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:05 2022] DELETE /identity/v3/users/92c0967326cb4661b8df91f5eedff526 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:06.093988 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.095434 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:06.108752 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa8b7f-3d17-458b-8a1f-d8e17bbb7c0f admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:06.165694 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:06.166332 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.166614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.166888 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] PATH_INFO: `/v3/projects/78d5dd7959d64d59bff5261af8e19c69` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.168092 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78d5dd7959d64d59bff5261af8e19c69)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:06.170132 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:06.192309 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:06.216928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78d5dd7959d64d59bff5261af8e19c69', 'request_id': 'req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:06.224069 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78d5dd7959d64d59bff5261af8e19c69', 'request_id': 'req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:06.230017 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78d5dd7959d64d59bff5261af8e19c69', 'request_id': 'req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:06.240540 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] The token cache is being invalidate because project 78d5dd7959d64d59bff5261af8e19c69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:06.240825 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:06.241484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-40fd57f1-ee89-42f7-b06b-d9f1bcc51bb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:06.243564 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1428/2875] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:06 2022] DELETE /identity/v3/projects/78d5dd7959d64d59bff5261af8e19c69 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:06.249385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d4c09-a0a3-40bc-b7e9-f6ab43765c4a None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.249858 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d4c09-a0a3-40bc-b7e9-f6ab43765c4a None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.249995 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d4c09-a0a3-40bc-b7e9-f6ab43765c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.270476 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-483d4c09-a0a3-40bc-b7e9-f6ab43765c4a None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:06.271671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-483d4c09-a0a3-40bc-b7e9-f6ab43765c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:06.328699 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1448/2876] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:06.338153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb52ec-c456-4e94-a72b-c56d16f8d584 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.338438 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb52ec-c456-4e94-a72b-c56d16f8d584 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.338714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb52ec-c456-4e94-a72b-c56d16f8d584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.358400 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-34bb52ec-c456-4e94-a72b-c56d16f8d584 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:06.359529 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-34bb52ec-c456-4e94-a72b-c56d16f8d584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:06.367297 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1429/2877] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:06.371935 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d4c09-a0a3-40bc-b7e9-f6ab43765c4a None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.381424 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d4c09-a0a3-40bc-b7e9-f6ab43765c4a None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:06.386188 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0e391-3cdd-452a-8248-618e3ea00fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:06.386782 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0e391-3cdd-452a-8248-618e3ea00fd4 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.387064 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0e391-3cdd-452a-8248-618e3ea00fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.387336 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0e391-3cdd-452a-8248-618e3ea00fd4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.387978 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0e391-3cdd-452a-8248-618e3ea00fd4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87920) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:56:06.388283 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0e391-3cdd-452a-8248-618e3ea00fd4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:06.389913 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed0e391-3cdd-452a-8248-618e3ea00fd4 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:06.401276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1449/2878] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:56:06.405557 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb52ec-c456-4e94-a72b-c56d16f8d584 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.415423 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb52ec-c456-4e94-a72b-c56d16f8d584 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:06.420703 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eafc5-4e3b-4bf3-bc32-f35987ea53fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:06.420850 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eafc5-4e3b-4bf3-bc32-f35987ea53fd admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.421133 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eafc5-4e3b-4bf3-bc32-f35987ea53fd admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.421440 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eafc5-4e3b-4bf3-bc32-f35987ea53fd admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.422073 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eafc5-4e3b-4bf3-bc32-f35987ea53fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:06.423993 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26eafc5-4e3b-4bf3-bc32-f35987ea53fd admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:06.453462 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1430/2879] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:56:06 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:06.457636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0e391-3cdd-452a-8248-618e3ea00fd4 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.468189 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0e391-3cdd-452a-8248-618e3ea00fd4 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:06.491928 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:06.524556 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488ec00-ed4e-4420-b16b-7e0ce2e7c555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:06.525154 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488ec00-ed4e-4420-b16b-7e0ce2e7c555 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.525459 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488ec00-ed4e-4420-b16b-7e0ce2e7c555 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.525739 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488ec00-ed4e-4420-b16b-7e0ce2e7c555 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.526371 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488ec00-ed4e-4420-b16b-7e0ce2e7c555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:06.528267 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2488ec00-ed4e-4420-b16b-7e0ce2e7c555 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:06.549277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1450/2880] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:56:06 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:56:06.553457 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eafc5-4e3b-4bf3-bc32-f35987ea53fd admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.563604 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26eafc5-4e3b-4bf3-bc32-f35987ea53fd admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:06.568244 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85871a5e-9af9-4b1f-aae0-9863c3561cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:06.568842 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871a5e-9af9-4b1f-aae0-9863c3561cba admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.569126 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871a5e-9af9-4b1f-aae0-9863c3561cba admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.569441 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85871a5e-9af9-4b1f-aae0-9863c3561cba admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.570071 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85871a5e-9af9-4b1f-aae0-9863c3561cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:06.571813 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85871a5e-9af9-4b1f-aae0-9863c3561cba admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:06.581513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1431/2881] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:56:06.585022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488ec00-ed4e-4420-b16b-7e0ce2e7c555 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.595623 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488ec00-ed4e-4420-b16b-7e0ce2e7c555 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:06.600221 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b546d5c-707e-4b8f-a3f8-4731b7d4a9fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:06.600808 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b546d5c-707e-4b8f-a3f8-4731b7d4a9fe admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.601087 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b546d5c-707e-4b8f-a3f8-4731b7d4a9fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.601360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b546d5c-707e-4b8f-a3f8-4731b7d4a9fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.602073 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b546d5c-707e-4b8f-a3f8-4731b7d4a9fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:06.604230 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b546d5c-707e-4b8f-a3f8-4731b7d4a9fe admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:06.614673 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1451/2882] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:56:06.618791 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85871a5e-9af9-4b1f-aae0-9863c3561cba admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.628928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85871a5e-9af9-4b1f-aae0-9863c3561cba admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:06.633572 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f28a29-85ee-4b1b-9fe1-7d185470d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:06.634215 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f28a29-85ee-4b1b-9fe1-7d185470d5c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.634494 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f28a29-85ee-4b1b-9fe1-7d185470d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.634768 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f28a29-85ee-4b1b-9fe1-7d185470d5c9 admin admin] PATH_INFO: `/v3/projects/65397ac7590141d98422d8b9f264f04a/users/993db83d60624e01983e1442ceca6d26/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.650707 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f28a29-85ee-4b1b-9fe1-7d185470d5c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65397ac7590141d98422d8b9f264f04a, user_id=993db83d60624e01983e1442ceca6d26, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:06.653355 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f28a29-85ee-4b1b-9fe1-7d185470d5c9 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:06.666728 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1432/2883] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:56:06 2022] PUT /identity/v3/projects/65397ac7590141d98422d8b9f264f04a/users/993db83d60624e01983e1442ceca6d26/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:06.677849 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6cc38-f748-4d5b-bc42-b906b1c14201 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.678132 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6cc38-f748-4d5b-bc42-b906b1c14201 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.678402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d6cc38-f748-4d5b-bc42-b906b1c14201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.706238 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-95d6cc38-f748-4d5b-bc42-b906b1c14201 None None] MFA Rules not processed for user `993db83d60624e01983e1442ceca6d26`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:06.708257 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-95d6cc38-f748-4d5b-bc42-b906b1c14201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:06.775214 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1452/2884] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:06.779681 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f28a29-85ee-4b1b-9fe1-7d185470d5c9 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.839448 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f28a29-85ee-4b1b-9fe1-7d185470d5c9 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:06.844099 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bd474-6571-46d2-9beb-33f840081634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:06.844695 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bd474-6571-46d2-9beb-33f840081634 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.844974 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bd474-6571-46d2-9beb-33f840081634 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.845248 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1bd474-6571-46d2-9beb-33f840081634 admin admin] PATH_INFO: `/v3/projects` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.845908 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bd474-6571-46d2-9beb-33f840081634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:06.847808 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1bd474-6571-46d2-9beb-33f840081634 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:06.887413 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1433/2885] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:56:06 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:06.891294 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6cc38-f748-4d5b-bc42-b906b1c14201 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.902474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d6cc38-f748-4d5b-bc42-b906b1c14201 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:06.956425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf290cd2-bdb1-415c-9edf-24abcf5acf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:06.957022 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf290cd2-bdb1-415c-9edf-24abcf5acf14 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:06.957299 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf290cd2-bdb1-415c-9edf-24abcf5acf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:06.957596 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf290cd2-bdb1-415c-9edf-24abcf5acf14 admin admin] PATH_INFO: `/v3/users` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:06.958226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf290cd2-bdb1-415c-9edf-24abcf5acf14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:06.960127 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf290cd2-bdb1-415c-9edf-24abcf5acf14 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:06.980684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1453/2886] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:56:06 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 17 00:56:06.984803 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bd474-6571-46d2-9beb-33f840081634 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:06.995096 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1bd474-6571-46d2-9beb-33f840081634 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:07.000545 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f60a88-2915-4781-af85-b5e03a656b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:07.001163 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60a88-2915-4781-af85-b5e03a656b78 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:07.001495 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60a88-2915-4781-af85-b5e03a656b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:07.001928 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f60a88-2915-4781-af85-b5e03a656b78 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:07.002578 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f60a88-2915-4781-af85-b5e03a656b78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:07.004569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f60a88-2915-4781-af85-b5e03a656b78 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:07.015595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1434/2887] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:56:07.019593 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf290cd2-bdb1-415c-9edf-24abcf5acf14 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:07.029897 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf290cd2-bdb1-415c-9edf-24abcf5acf14 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:07.034480 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64e38e-f049-464b-b3ac-6ce200453f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:07.035112 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64e38e-f049-464b-b3ac-6ce200453f50 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:07.035390 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64e38e-f049-464b-b3ac-6ce200453f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:07.035663 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64e38e-f049-464b-b3ac-6ce200453f50 admin admin] PATH_INFO: `/v3/projects/91b90684d46c468886f66e6cc116930f/users/584f8ff517a3433d8e4911723288c27f/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:07.050114 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64e38e-f049-464b-b3ac-6ce200453f50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b90684d46c468886f66e6cc116930f, user_id=584f8ff517a3433d8e4911723288c27f, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:07.052765 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c64e38e-f049-464b-b3ac-6ce200453f50 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:07.062435 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:07.067412 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1454/2888] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:56:07 2022] PUT /identity/v3/projects/91b90684d46c468886f66e6cc116930f/users/584f8ff517a3433d8e4911723288c27f/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:07.071905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f60a88-2915-4781-af85-b5e03a656b78 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:07.081837 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f60a88-2915-4781-af85-b5e03a656b78 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:07.098678 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:07.141009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce00a3-fd9b-480c-a34a-116f1dc7fc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:07.141575 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce00a3-fd9b-480c-a34a-116f1dc7fc24 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:07.141856 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce00a3-fd9b-480c-a34a-116f1dc7fc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:07.142415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce00a3-fd9b-480c-a34a-116f1dc7fc24 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:07.143048 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce00a3-fd9b-480c-a34a-116f1dc7fc24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:07.144662 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce00a3-fd9b-480c-a34a-116f1dc7fc24 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:07.154966 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1435/2889] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 17 00:56:07.159142 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64e38e-f049-464b-b3ac-6ce200453f50 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:07.169289 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64e38e-f049-464b-b3ac-6ce200453f50 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:07.173875 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1d60c-f067-4c9c-99a2-99763aac4180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:07.174526 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1d60c-f067-4c9c-99a2-99763aac4180 admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:07.174806 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1d60c-f067-4c9c-99a2-99763aac4180 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:07.175080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1d60c-f067-4c9c-99a2-99763aac4180 admin admin] PATH_INFO: `/v3/projects/91b90684d46c468886f66e6cc116930f/users/584f8ff517a3433d8e4911723288c27f/roles/b2ca49dcc2ea4114875e545bc537bfb0` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:07.176981 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1d60c-f067-4c9c-99a2-99763aac4180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b90684d46c468886f66e6cc116930f, user_id=584f8ff517a3433d8e4911723288c27f, role_id=b2ca49dcc2ea4114875e545bc537bfb0)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:07.179640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc1d60c-f067-4c9c-99a2-99763aac4180 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:07.190282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1455/2890] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:56:07 2022] PUT /identity/v3/projects/91b90684d46c468886f66e6cc116930f/users/584f8ff517a3433d8e4911723288c27f/roles/b2ca49dcc2ea4114875e545bc537bfb0 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:07.201001 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40405b8-640b-4112-a413-17eda6a9ce32 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:07.201295 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40405b8-640b-4112-a413-17eda6a9ce32 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:07.201620 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40405b8-640b-4112-a413-17eda6a9ce32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:07.230303 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-d40405b8-640b-4112-a413-17eda6a9ce32 None None] MFA Rules not processed for user `584f8ff517a3433d8e4911723288c27f`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:07.231521 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d40405b8-640b-4112-a413-17eda6a9ce32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:07.297957 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1436/2891] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:07.309525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1d60c-f067-4c9c-99a2-99763aac4180 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:07.311217 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-0bc1d60c-f067-4c9c-99a2-99763aac4180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:07.368402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1d60c-f067-4c9c-99a2-99763aac4180 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:07.372118 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4ead1-c44b-4ba4-8fc6-0bcb1a6b4f4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:07.372714 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4ead1-c44b-4ba4-8fc6-0bcb1a6b4f4b service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:07.372999 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4ead1-c44b-4ba4-8fc6-0bcb1a6b4f4b service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:07.373276 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4ead1-c44b-4ba4-8fc6-0bcb1a6b4f4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:07.382111 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4ead1-c44b-4ba4-8fc6-0bcb1a6b4f4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:07.384135 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba4ead1-c44b-4ba4-8fc6-0bcb1a6b4f4b service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:07.393487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1456/2892] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:07 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:07.817807 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40405b8-640b-4112-a413-17eda6a9ce32 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:07.880217 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40405b8-640b-4112-a413-17eda6a9ce32 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:07.884800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:07.885461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:07.885749 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:07.886028 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] PATH_INFO: `/v3/users/993db83d60624e01983e1442ceca6d26` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:07.887150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=993db83d60624e01983e1442ceca6d26)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:07.889076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:07.932488 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:07.934899 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '993db83d60624e01983e1442ceca6d26'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:07.942793 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '993db83d60624e01983e1442ceca6d26'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:07.943421 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '993db83d60624e01983e1442ceca6d26'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:07.955113 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '993db83d60624e01983e1442ceca6d26'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:07.962792 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '993db83d60624e01983e1442ceca6d26'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:07.968625 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1437/2893] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:07 2022] DELETE /identity/v3/users/993db83d60624e01983e1442ceca6d26 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:56:07.973050 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b8b02-2d95-4094-ab69-41e7ddf1ee8d None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:07.973331 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b8b02-2d95-4094-ab69-41e7ddf1ee8d None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:07.973636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b8b02-2d95-4094-ab69-41e7ddf1ee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:07.992545 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-9c9b8b02-2d95-4094-ab69-41e7ddf1ee8d None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:07.993832 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9c9b8b02-2d95-4094-ab69-41e7ddf1ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:08.050555 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1457/2894] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:08.060150 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:08.061648 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:08.118470 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b4d0a-78a7-47f6-8619-ca3f368675a1 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:08.122760 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201722bf-1c5b-46fc-b20f-4d4ffbc781ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:08.123365 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201722bf-1c5b-46fc-b20f-4d4ffbc781ab service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:08.123647 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201722bf-1c5b-46fc-b20f-4d4ffbc781ab service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:08.123923 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201722bf-1c5b-46fc-b20f-4d4ffbc781ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:08.133009 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201722bf-1c5b-46fc-b20f-4d4ffbc781ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:08.134461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201722bf-1c5b-46fc-b20f-4d4ffbc781ab service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:08.143745 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1438/2895] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:08.411093 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b8b02-2d95-4094-ab69-41e7ddf1ee8d None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:08.412517 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9c9b8b02-2d95-4094-ab69-41e7ddf1ee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:08.426961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b8b02-2d95-4094-ab69-41e7ddf1ee8d None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:08.441134 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:08.441810 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:08.442091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:08.442364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] PATH_INFO: `/v3/projects/65397ac7590141d98422d8b9f264f04a` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:08.443488 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65397ac7590141d98422d8b9f264f04a)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:08.445386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:08.493767 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65397ac7590141d98422d8b9f264f04a', 'request_id': 'req-135b763b-8ba8-4ec5-902c-947df2a28b05'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.500991 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65397ac7590141d98422d8b9f264f04a', 'request_id': 'req-135b763b-8ba8-4ec5-902c-947df2a28b05'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.507090 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65397ac7590141d98422d8b9f264f04a', 'request_id': 'req-135b763b-8ba8-4ec5-902c-947df2a28b05'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.518734 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] The token cache is being invalidate because project 65397ac7590141d98422d8b9f264f04a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:08.519025 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.519670 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.521161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1458/2896] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:08 2022] DELETE /identity/v3/projects/65397ac7590141d98422d8b9f264f04a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:08.525939 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201722bf-1c5b-46fc-b20f-4d4ffbc781ab service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:08.535767 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201722bf-1c5b-46fc-b20f-4d4ffbc781ab service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:08.591312 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:08.591943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:08.592224 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:08.592500 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] PATH_INFO: `/v3/users/584f8ff517a3433d8e4911723288c27f` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:08.593665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] RBAC: Authorizing `identity:delete_user(user_id=584f8ff517a3433d8e4911723288c27f)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:08.595641 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:08.641307 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '584f8ff517a3433d8e4911723288c27f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.648712 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '584f8ff517a3433d8e4911723288c27f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.649943 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '584f8ff517a3433d8e4911723288c27f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.657828 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:08.663020 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '584f8ff517a3433d8e4911723288c27f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.671021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-c841048e-8a9d-4c63-9228-385c0aac9739 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '584f8ff517a3433d8e4911723288c27f'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:08.676979 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1439/2897] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:08 2022] DELETE /identity/v3/users/584f8ff517a3433d8e4911723288c27f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:08.944249 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:08.946347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:08.959415 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b763b-8ba8-4ec5-902c-947df2a28b05 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:08.968893 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:09.019241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:09.019886 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.020171 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.020446 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] PATH_INFO: `/v3/projects/91b90684d46c468886f66e6cc116930f` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.021640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b90684d46c468886f66e6cc116930f)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:09.023502 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:09.069161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b90684d46c468886f66e6cc116930f', 'request_id': 'req-cde2236d-fc3b-4a76-b91d-0910dd8a5514'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:09.076157 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b90684d46c468886f66e6cc116930f', 'request_id': 'req-cde2236d-fc3b-4a76-b91d-0910dd8a5514'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:09.081759 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b90684d46c468886f66e6cc116930f', 'request_id': 'req-cde2236d-fc3b-4a76-b91d-0910dd8a5514'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:09.092936 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] The token cache is being invalidate because project 91b90684d46c468886f66e6cc116930f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:09.093241 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:09.093902 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-cde2236d-fc3b-4a76-b91d-0910dd8a5514 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:09.095379 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1459/2898] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:08 2022] DELETE /identity/v3/projects/91b90684d46c468886f66e6cc116930f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:09.100192 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6238efd-2144-405d-8c21-1764122966be None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.100687 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6238efd-2144-405d-8c21-1764122966be None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.100786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6238efd-2144-405d-8c21-1764122966be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.122810 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-f6238efd-2144-405d-8c21-1764122966be None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:09.124060 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-f6238efd-2144-405d-8c21-1764122966be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:09.182555 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1440/2899] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:09.190002 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb78bc-553f-4427-b12f-506ec95b623b None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.190301 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb78bc-553f-4427-b12f-506ec95b623b None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.190575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cb78bc-553f-4427-b12f-506ec95b623b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.209997 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-40cb78bc-553f-4427-b12f-506ec95b623b None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:09.211461 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-40cb78bc-553f-4427-b12f-506ec95b623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:09.219595 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1460/2900] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:09.223371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6238efd-2144-405d-8c21-1764122966be None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:09.233280 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6238efd-2144-405d-8c21-1764122966be None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:09.237848 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9297e3-a598-49ba-a4d0-ef11f5eb6b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:09.238426 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9297e3-a598-49ba-a4d0-ef11f5eb6b4c admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.238701 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9297e3-a598-49ba-a4d0-ef11f5eb6b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.238970 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9297e3-a598-49ba-a4d0-ef11f5eb6b4c admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.239607 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9297e3-a598-49ba-a4d0-ef11f5eb6b4c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:56:09.239905 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9297e3-a598-49ba-a4d0-ef11f5eb6b4c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:09.241506 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9297e3-a598-49ba-a4d0-ef11f5eb6b4c admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:09.253149 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1441/2901] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:56:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:56:09.257385 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb78bc-553f-4427-b12f-506ec95b623b None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:09.266430 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cb78bc-553f-4427-b12f-506ec95b623b None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:09.271080 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b43617-160e-4076-aa48-1116220c4630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:09.271721 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b43617-160e-4076-aa48-1116220c4630 admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.271951 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b43617-160e-4076-aa48-1116220c4630 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.272222 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b43617-160e-4076-aa48-1116220c4630 admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.272847 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b43617-160e-4076-aa48-1116220c4630 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:09.274877 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b43617-160e-4076-aa48-1116220c4630 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:09.301742 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1461/2902] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:56:09 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:09.306552 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9297e3-a598-49ba-a4d0-ef11f5eb6b4c admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:09.316512 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9297e3-a598-49ba-a4d0-ef11f5eb6b4c admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:09.370898 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35365282-ffba-497a-a4fb-70017052b396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:09.371492 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35365282-ffba-497a-a4fb-70017052b396 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.371771 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35365282-ffba-497a-a4fb-70017052b396 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.372044 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35365282-ffba-497a-a4fb-70017052b396 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.372658 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35365282-ffba-497a-a4fb-70017052b396 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:09.374590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35365282-ffba-497a-a4fb-70017052b396 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:09.395021 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1442/2903] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:56:09 2022] POST /identity/v3/users => generated 288 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:09.399178 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b43617-160e-4076-aa48-1116220c4630 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:09.409678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b43617-160e-4076-aa48-1116220c4630 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:09.414976 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb4fc-0971-4c7e-a24b-dd609c735da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:09.415578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb4fc-0971-4c7e-a24b-dd609c735da5 admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.415859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb4fc-0971-4c7e-a24b-dd609c735da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.416130 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813bb4fc-0971-4c7e-a24b-dd609c735da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.416775 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bb4fc-0971-4c7e-a24b-dd609c735da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:09.418409 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813bb4fc-0971-4c7e-a24b-dd609c735da5 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:09.429060 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1462/2904] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:56:09.433664 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35365282-ffba-497a-a4fb-70017052b396 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:09.443630 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35365282-ffba-497a-a4fb-70017052b396 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:09.448190 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e7ac7-9781-4e8c-ac02-ea530ef44ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:09.448787 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7ac7-9781-4e8c-ac02-ea530ef44ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.449068 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7ac7-9781-4e8c-ac02-ea530ef44ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.449342 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e7ac7-9781-4e8c-ac02-ea530ef44ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.450019 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e7ac7-9781-4e8c-ac02-ea530ef44ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:09.451614 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e7ac7-9781-4e8c-ac02-ea530ef44ba8 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:09.462736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1443/2905] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:56:09.466703 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb4fc-0971-4c7e-a24b-dd609c735da5 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:09.476375 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813bb4fc-0971-4c7e-a24b-dd609c735da5 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:09.481376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b777f4-2851-4cdb-a2cd-0af8cac8569a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:09.482041 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b777f4-2851-4cdb-a2cd-0af8cac8569a admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.482327 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b777f4-2851-4cdb-a2cd-0af8cac8569a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.482603 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b777f4-2851-4cdb-a2cd-0af8cac8569a admin admin] PATH_INFO: `/v3/projects/c66e8b6b254e4ab79e4d64384655f197/users/5aa3c478a33d4046a14fccbf48292e9e/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.496840 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b777f4-2851-4cdb-a2cd-0af8cac8569a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c66e8b6b254e4ab79e4d64384655f197, user_id=5aa3c478a33d4046a14fccbf48292e9e, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:09.499546 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b777f4-2851-4cdb-a2cd-0af8cac8569a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:09.512353 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1463/2906] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:56:09 2022] PUT /identity/v3/projects/c66e8b6b254e4ab79e4d64384655f197/users/5aa3c478a33d4046a14fccbf48292e9e/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:56:09.522284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd6f1-ae43-4042-b240-0707d2877454 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.522503 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd6f1-ae43-4042-b240-0707d2877454 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.522778 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadd6f1-ae43-4042-b240-0707d2877454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.552375 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-9eadd6f1-ae43-4042-b240-0707d2877454 None None] MFA Rules not processed for user `5aa3c478a33d4046a14fccbf48292e9e`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:09.553600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-9eadd6f1-ae43-4042-b240-0707d2877454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:09.590085 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:09.617840 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1444/2907] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:09.629029 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b777f4-2851-4cdb-a2cd-0af8cac8569a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:09.630732 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-26b777f4-2851-4cdb-a2cd-0af8cac8569a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:09.675770 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:09.691282 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b777f4-2851-4cdb-a2cd-0af8cac8569a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:09.695026 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ae3253-f14e-4836-8ca5-122c08104c5c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'babdd851ad7b4ba99b5746d8480bc082', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:09.695640 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae3253-f14e-4836-8ca5-122c08104c5c service glance] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:09.695922 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae3253-f14e-4836-8ca5-122c08104c5c service glance] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:09.696203 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ae3253-f14e-4836-8ca5-122c08104c5c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:09.704386 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae3253-f14e-4836-8ca5-122c08104c5c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:09.705866 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ae3253-f14e-4836-8ca5-122c08104c5c service glance] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:09.715657 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1464/2908] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:09 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:19.614915 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=10 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:19.710522 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=8 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:24.147422 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadd6f1-ae43-4042-b240-0707d2877454 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:24.208087 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadd6f1-ae43-4042-b240-0707d2877454 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:24.213697 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:24.214348 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:24.214636 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:24.214914 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] PATH_INFO: `/v3/users/5aa3c478a33d4046a14fccbf48292e9e` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:24.216041 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa3c478a33d4046a14fccbf48292e9e)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:24.218011 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:24.262010 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa3c478a33d4046a14fccbf48292e9e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.268890 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa3c478a33d4046a14fccbf48292e9e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.269544 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa3c478a33d4046a14fccbf48292e9e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.282116 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa3c478a33d4046a14fccbf48292e9e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.288884 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa3c478a33d4046a14fccbf48292e9e'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.294718 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1445/2909] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:24 2022] DELETE /identity/v3/users/5aa3c478a33d4046a14fccbf48292e9e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:24.299198 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6760ea-65af-416d-b44f-3299f898b42c None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:24.299692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6760ea-65af-416d-b44f-3299f898b42c None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:24.299795 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6760ea-65af-416d-b44f-3299f898b42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:24.318525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-ab6760ea-65af-416d-b44f-3299f898b42c None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:24.319727 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ab6760ea-65af-416d-b44f-3299f898b42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:24.377611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1465/2910] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:24.387734 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:24.389125 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:24.444847 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a17f0-15aa-4576-a7d7-bceb8da97c61 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:24.449143 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bccc51f-4e81-49ee-8998-c08393bdc0bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:24.449786 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccc51f-4e81-49ee-8998-c08393bdc0bc service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:24.450063 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccc51f-4e81-49ee-8998-c08393bdc0bc service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:24.450333 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bccc51f-4e81-49ee-8998-c08393bdc0bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:24.459081 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccc51f-4e81-49ee-8998-c08393bdc0bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:24.460502 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bccc51f-4e81-49ee-8998-c08393bdc0bc service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:24.469967 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1446/2911] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:24.725011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6760ea-65af-416d-b44f-3299f898b42c None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:24.726457 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ab6760ea-65af-416d-b44f-3299f898b42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:24.738641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6760ea-65af-416d-b44f-3299f898b42c None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:24.743266 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:24.744688 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:24.745045 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:24.745538 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] PATH_INFO: `/v3/projects/c66e8b6b254e4ab79e4d64384655f197` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:24.746675 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c66e8b6b254e4ab79e4d64384655f197)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:24.749277 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:24.797067 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c66e8b6b254e4ab79e4d64384655f197', 'request_id': 'req-9e7a3f95-5ee6-4c95-8a01-9050c834b204'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.804232 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c66e8b6b254e4ab79e4d64384655f197', 'request_id': 'req-9e7a3f95-5ee6-4c95-8a01-9050c834b204'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.810425 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c66e8b6b254e4ab79e4d64384655f197', 'request_id': 'req-9e7a3f95-5ee6-4c95-8a01-9050c834b204'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.821550 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] The token cache is being invalidate because project c66e8b6b254e4ab79e4d64384655f197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:24.821839 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.822474 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-9e7a3f95-5ee6-4c95-8a01-9050c834b204 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:24.824034 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1466/2912] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:24 2022] DELETE /identity/v3/projects/c66e8b6b254e4ab79e4d64384655f197 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:24.828874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43f40d-ec28-4f0c-ba7e-bcec96d4d020 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:24.829155 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43f40d-ec28-4f0c-ba7e-bcec96d4d020 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:24.829443 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43f40d-ec28-4f0c-ba7e-bcec96d4d020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:24.849197 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-7b43f40d-ec28-4f0c-ba7e-bcec96d4d020 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:24.850428 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-7b43f40d-ec28-4f0c-ba7e-bcec96d4d020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:24.867371 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:24.910580 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1447/2913] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:24.919975 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fca5f6-c7cb-43a1-be73-214c09dec928 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:24.920263 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fca5f6-c7cb-43a1-be73-214c09dec928 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:24.920541 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fca5f6-c7cb-43a1-be73-214c09dec928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:24.940322 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-b4fca5f6-c7cb-43a1-be73-214c09dec928 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:24.941559 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-b4fca5f6-c7cb-43a1-be73-214c09dec928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:24.949267 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1467/2914] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:24.953356 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43f40d-ec28-4f0c-ba7e-bcec96d4d020 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:24.963308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43f40d-ec28-4f0c-ba7e-bcec96d4d020 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:24.967814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884833d-bf03-4de0-8f47-3241af4e3064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:24.968405 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884833d-bf03-4de0-8f47-3241af4e3064 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:24.968682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884833d-bf03-4de0-8f47-3241af4e3064 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:24.968954 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2884833d-bf03-4de0-8f47-3241af4e3064 admin admin] PATH_INFO: `/v3/domains` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:24.969627 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884833d-bf03-4de0-8f47-3241af4e3064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87919) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 17 00:56:24.969929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884833d-bf03-4de0-8f47-3241af4e3064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:24.971513 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2884833d-bf03-4de0-8f47-3241af4e3064 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:24.983433 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1448/2915] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 17 00:56:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 17 00:56:24.987295 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fca5f6-c7cb-43a1-be73-214c09dec928 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:24.996884 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fca5f6-c7cb-43a1-be73-214c09dec928 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:25.001494 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f96d9a-1690-4c83-8597-7b9c184e580a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:25.002078 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96d9a-1690-4c83-8597-7b9c184e580a admin admin] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:25.002360 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96d9a-1690-4c83-8597-7b9c184e580a admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:25.002636 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96d9a-1690-4c83-8597-7b9c184e580a admin admin] PATH_INFO: `/v3/projects` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:25.003256 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f96d9a-1690-4c83-8597-7b9c184e580a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:25.005126 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f96d9a-1690-4c83-8597-7b9c184e580a admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:25.032404 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1468/2916] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 17 00:56:24 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:25.036461 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884833d-bf03-4de0-8f47-3241af4e3064 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:25.046912 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2884833d-bf03-4de0-8f47-3241af4e3064 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:25.101053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ade70d-dabf-4f30-885d-6ba6d6d51749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:25.101673 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ade70d-dabf-4f30-885d-6ba6d6d51749 admin admin] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:25.101951 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ade70d-dabf-4f30-885d-6ba6d6d51749 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:25.102225 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ade70d-dabf-4f30-885d-6ba6d6d51749 admin admin] PATH_INFO: `/v3/users` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:25.103353 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ade70d-dabf-4f30-885d-6ba6d6d51749 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:25.105259 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ade70d-dabf-4f30-885d-6ba6d6d51749 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:25.131298 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1449/2917] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 17 00:56:25 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 17 00:56:25.135496 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f96d9a-1690-4c83-8597-7b9c184e580a admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:25.145656 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f96d9a-1690-4c83-8597-7b9c184e580a admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:25.150805 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4388-cf58-42a6-9a99-054fff538bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:25.151397 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4388-cf58-42a6-9a99-054fff538bcb admin admin] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:25.151678 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4388-cf58-42a6-9a99-054fff538bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:25.151950 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320e4388-cf58-42a6-9a99-054fff538bcb admin admin] PATH_INFO: `/v3/roles` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:25.152591 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e4388-cf58-42a6-9a99-054fff538bcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:25.154255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320e4388-cf58-42a6-9a99-054fff538bcb admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:25.164088 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1469/2918] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:56:25.168236 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ade70d-dabf-4f30-885d-6ba6d6d51749 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:25.178130 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ade70d-dabf-4f30-885d-6ba6d6d51749 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:25.182814 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86038c9b-c43e-4bb9-ad7c-4a986bdd0074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:25.183403 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038c9b-c43e-4bb9-ad7c-4a986bdd0074 admin admin] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:25.183682 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038c9b-c43e-4bb9-ad7c-4a986bdd0074 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:25.183960 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86038c9b-c43e-4bb9-ad7c-4a986bdd0074 admin admin] PATH_INFO: `/v3/roles` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:25.184595 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86038c9b-c43e-4bb9-ad7c-4a986bdd0074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:25.186228 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86038c9b-c43e-4bb9-ad7c-4a986bdd0074 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:25.196415 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1450/2919] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 17 00:56:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 17 00:56:25.200255 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4388-cf58-42a6-9a99-054fff538bcb admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:25.209878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320e4388-cf58-42a6-9a99-054fff538bcb admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:25.215194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178915f0-e6c5-4060-b4b2-b83a5ac2a45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:25.215824 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178915f0-e6c5-4060-b4b2-b83a5ac2a45c admin admin] REQUEST_METHOD: `PUT` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:25.216104 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178915f0-e6c5-4060-b4b2-b83a5ac2a45c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:25.216376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178915f0-e6c5-4060-b4b2-b83a5ac2a45c admin admin] PATH_INFO: `/v3/projects/5f16134809e74557848ff1d4b5536689/users/c810197a8b3e4b40b3bf08567bba845a/roles/165f39c0a24042fdacc0121c96347bcd` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:25.232313 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178915f0-e6c5-4060-b4b2-b83a5ac2a45c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f16134809e74557848ff1d4b5536689, user_id=c810197a8b3e4b40b3bf08567bba845a, role_id=165f39c0a24042fdacc0121c96347bcd)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:25.235023 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178915f0-e6c5-4060-b4b2-b83a5ac2a45c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:25.248239 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1470/2920] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 17 00:56:25 2022] PUT /identity/v3/projects/5f16134809e74557848ff1d4b5536689/users/c810197a8b3e4b40b3bf08567bba845a/roles/165f39c0a24042fdacc0121c96347bcd => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 17 00:56:25.258639 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34378-05cc-4a5a-8d50-d52fb286a311 None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:25.258930 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34378-05cc-4a5a-8d50-d52fb286a311 None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:25.259275 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f34378-05cc-4a5a-8d50-d52fb286a311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:25.288174 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-86f34378-05cc-4a5a-8d50-d52fb286a311 None None] MFA Rules not processed for user `c810197a8b3e4b40b3bf08567bba845a`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:25.289382 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-86f34378-05cc-4a5a-8d50-d52fb286a311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:25.352308 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1451/2921] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:25.363681 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178915f0-e6c5-4060-b4b2-b83a5ac2a45c admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:25.365431 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-178915f0-e6c5-4060-b4b2-b83a5ac2a45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:25.386882 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:25.423838 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178915f0-e6c5-4060-b4b2-b83a5ac2a45c admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:25.427514 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375777ca-5482-4856-a60a-ec624565f411 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29e517f2741c4f14877ba49d5be2229a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:25.428237 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375777ca-5482-4856-a60a-ec624565f411 service cinder] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:25.428525 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375777ca-5482-4856-a60a-ec624565f411 service cinder] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:25.428800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375777ca-5482-4856-a60a-ec624565f411 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:25.437511 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375777ca-5482-4856-a60a-ec624565f411 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:25.438961 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375777ca-5482-4856-a60a-ec624565f411 service cinder] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:25.447687 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1471/2922] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:34.494785 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f34378-05cc-4a5a-8d50-d52fb286a311 None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:34.513485 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:34.557833 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f34378-05cc-4a5a-8d50-d52fb286a311 None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:34.562419 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:34.563053 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:34.563341 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:34.563619 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] PATH_INFO: `/v3/users/c810197a8b3e4b40b3bf08567bba845a` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:34.564736 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c810197a8b3e4b40b3bf08567bba845a)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:34.566722 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:34.614711 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c810197a8b3e4b40b3bf08567bba845a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:34.622685 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c810197a8b3e4b40b3bf08567bba845a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:34.623316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c810197a8b3e4b40b3bf08567bba845a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:34.635623 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c810197a8b3e4b40b3bf08567bba845a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:34.642478 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c810197a8b3e4b40b3bf08567bba845a'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:34.648346 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1452/2923] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:56:34 2022] DELETE /identity/v3/users/c810197a8b3e4b40b3bf08567bba845a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:34.652800 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63cd6c-40ba-4248-998f-563d9aadd646 None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:34.653270 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63cd6c-40ba-4248-998f-563d9aadd646 None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:34.653370 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d63cd6c-40ba-4248-998f-563d9aadd646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:34.672402 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-9d63cd6c-40ba-4248-998f-563d9aadd646 None None] MFA Rules not processed for user `50b388ebd083407da9c5b53df1e1692d`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:56:34.673642 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9d63cd6c-40ba-4248-998f-563d9aadd646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:34.731011 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1472/2924] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 17 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:56:34.741777 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:34.744318 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:34.799569 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1c407c-6053-441f-b1fc-5dea73613b66 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:34.803291 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c24572-e37a-498c-8bbd-e15715eb8c76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:34.803897 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c24572-e37a-498c-8bbd-e15715eb8c76 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:34.804177 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c24572-e37a-498c-8bbd-e15715eb8c76 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:34.804452 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c24572-e37a-498c-8bbd-e15715eb8c76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:34.813929 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c24572-e37a-498c-8bbd-e15715eb8c76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:34.815366 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c24572-e37a-498c-8bbd-e15715eb8c76 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:34.824844 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1453/2925] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:35.087406 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63cd6c-40ba-4248-998f-563d9aadd646 None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:35.088830 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-9d63cd6c-40ba-4248-998f-563d9aadd646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:35.103318 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d63cd6c-40ba-4248-998f-563d9aadd646 None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:35.108005 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:35.108641 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:35.108921 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:35.109194 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] PATH_INFO: `/v3/projects/5f16134809e74557848ff1d4b5536689` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:35.110358 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f16134809e74557848ff1d4b5536689)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:35.112271 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:35.161330 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f16134809e74557848ff1d4b5536689', 'request_id': 'req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:35.169215 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f16134809e74557848ff1d4b5536689', 'request_id': 'req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:35.175083 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f16134809e74557848ff1d4b5536689', 'request_id': 'req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:35.186161 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] The token cache is being invalidate because project 5f16134809e74557848ff1d4b5536689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87920) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:56:35.186450 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:35.187103 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-f72e2dc1-415a-49f4-87b4-3209df4e0f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:56:35.188572 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1473/2926] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:56:35 2022] DELETE /identity/v3/projects/5f16134809e74557848ff1d4b5536689 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:56:44.765690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c24572-e37a-498c-8bbd-e15715eb8c76 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:56:44.767076 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-32c24572-e37a-498c-8bbd-e15715eb8c76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:44.811586 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:44.911058 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c24572-e37a-498c-8bbd-e15715eb8c76 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:56:44.972665 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8407f-fad7-4e9a-8a5f-2204b45eb354 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:56:44.973316 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8407f-fad7-4e9a-8a5f-2204b45eb354 service placement] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:56:44.973638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8407f-fad7-4e9a-8a5f-2204b45eb354 service placement] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:56:44.973918 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8407f-fad7-4e9a-8a5f-2204b45eb354 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:56:44.975700 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5fd8407f-fad7-4e9a-8a5f-2204b45eb354 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:56:44.987274 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8407f-fad7-4e9a-8a5f-2204b45eb354 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:56:44.988868 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8407f-fad7-4e9a-8a5f-2204b45eb354 service placement] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:56:44.999484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1454/2927] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:56:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:56:45.183033 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:56:54.995110 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=71 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:57:55.399741 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489785-b5af-43a7-9a08-9cb13684a55e None None] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:57:55.400369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489785-b5af-43a7-9a08-9cb13684a55e None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:57:55.400369 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61489785-b5af-43a7-9a08-9cb13684a55e None None] PATH_INFO: `/` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:57:55.401837 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1474/2928] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:57:55.409029 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9d00-9b32-4d99-ba9d-8824060e4fff None None] REQUEST_METHOD: `POST` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:57:55.409574 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9d00-9b32-4d99-ba9d-8824060e4fff None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:57:55.409689 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9d00-9b32-4d99-ba9d-8824060e4fff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:57:55.472340 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.auth.core [None req-3c4f9d00-9b32-4d99-ba9d-8824060e4fff None None] MFA Rules not processed for user `537d07153d3f4adfb3296c4e8e7084bb`. Rule list: `[]` (Enabled: `True`). {{(pid=87919) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:57:55.473633 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-3c4f9d00-9b32-4d99-ba9d-8824060e4fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:57:55.557164 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1455/2929] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 17 00:57:55.570917 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61489785-b5af-43a7-9a08-9cb13684a55e None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:57:55.572909 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-61489785-b5af-43a7-9a08-9cb13684a55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:57:55.586382 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61489785-b5af-43a7-9a08-9cb13684a55e None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:57:55.590421 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490b1b6-4431-439d-a222-43780964e407 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:57:55.591012 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b1b6-4431-439d-a222-43780964e407 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:57:55.591342 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b1b6-4431-439d-a222-43780964e407 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:57:55.591565 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b1b6-4431-439d-a222-43780964e407 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:57:55.598439 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490b1b6-4431-439d-a222-43780964e407 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:57:55.599855 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490b1b6-4431-439d-a222-43780964e407 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:57:55.608037 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1475/2930] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:57:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:57:55.687714 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae94b8-fba8-4a75-a141-98fdfde8ad5c None None] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:57:55.688004 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae94b8-fba8-4a75-a141-98fdfde8ad5c None None] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:57:55.688284 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ae94b8-fba8-4a75-a141-98fdfde8ad5c None None] PATH_INFO: `/` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:57:55.689673 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1456/2931] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 17 00:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 17 00:57:55.694535 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e7c1e-52f6-4577-9d91-e9988a98beae None None] REQUEST_METHOD: `POST` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:57:55.694825 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e7c1e-52f6-4577-9d91-e9988a98beae None None] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:57:55.695136 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559e7c1e-52f6-4577-9d91-e9988a98beae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:57:55.726487 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.auth.core [None req-559e7c1e-52f6-4577-9d91-e9988a98beae None None] MFA Rules not processed for user `2dbd23de9096446091fb9b7f79f047fc`. Rule list: `[]` (Enabled: `True`). {{(pid=87920) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 17 00:57:55.727684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-559e7c1e-52f6-4577-9d91-e9988a98beae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:57:55.810324 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1476/2932] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 17 00:57:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 17 00:57:55.820800 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae94b8-fba8-4a75-a141-98fdfde8ad5c None None] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:57:55.832153 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ae94b8-fba8-4a75-a141-98fdfde8ad5c None None] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:57:55.835900 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01252205-4031-442f-930f-ee99fa355970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:57:55.836484 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252205-4031-442f-930f-ee99fa355970 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:57:55.836765 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252205-4031-442f-930f-ee99fa355970 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:57:55.837035 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01252205-4031-442f-930f-ee99fa355970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:57:55.846798 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01252205-4031-442f-930f-ee99fa355970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:57:55.848169 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01252205-4031-442f-930f-ee99fa355970 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:57:55.858954 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1457/2933] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:57:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:58:05.807499 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=49 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:58:05.854455 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=46 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:59:15.638460 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e7c1e-52f6-4577-9d91-e9988a98beae None None] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:59:15.640225 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-559e7c1e-52f6-4577-9d91-e9988a98beae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:59:15.656427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559e7c1e-52f6-4577-9d91-e9988a98beae None None] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:59:15.663399 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfe1db-26e7-4002-a1bb-6518e61a1c32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2dbd23de9096446091fb9b7f79f047fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'service', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:59:15.664034 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfe1db-26e7-4002-a1bb-6518e61a1c32 service nova] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:59:15.664319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfe1db-26e7-4002-a1bb-6518e61a1c32 service nova] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:59:15.664599 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfe1db-26e7-4002-a1bb-6518e61a1c32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:59:15.666422 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-11bfe1db-26e7-4002-a1bb-6518e61a1c32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:59:15.679653 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfe1db-26e7-4002-a1bb-6518e61a1c32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:59:15.681376 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfe1db-26e7-4002-a1bb-6518e61a1c32 service nova] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:59:15.701575 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1477/2934] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:59:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:59:15.767541 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01252205-4031-442f-930f-ee99fa355970 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:59:15.778794 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01252205-4031-442f-930f-ee99fa355970 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:59:15.783402 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b943ca-7c51-4045-a00c-6a9057ccc359 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:59:15.784107 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b943ca-7c51-4045-a00c-6a9057ccc359 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:59:15.784393 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b943ca-7c51-4045-a00c-6a9057ccc359 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:59:15.784667 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b943ca-7c51-4045-a00c-6a9057ccc359 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:59:15.786672 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-d6b943ca-7c51-4045-a00c-6a9057ccc359 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:59:15.798608 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b943ca-7c51-4045-a00c-6a9057ccc359 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:59:15.799963 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b943ca-7c51-4045-a00c-6a9057ccc359 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:59:15.812250 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1458/2935] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:59:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 17 00:59:15.848878 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfe1db-26e7-4002-a1bb-6518e61a1c32 service nova] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:59:15.860692 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfe1db-26e7-4002-a1bb-6518e61a1c32 service nova] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:59:15.864297 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:59:15.864947 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:59:15.865226 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:59:15.865536 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:59:15.867445 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:59:15.882141 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:59:15.883573 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:59:15.895364 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1478/2936] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:59:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:59:17.076553 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b943ca-7c51-4045-a00c-6a9057ccc359 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:59:17.084973 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b943ca-7c51-4045-a00c-6a9057ccc359 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:59:17.089312 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6faeb1-32dd-48a5-8081-ba36e36d9ff0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '537d07153d3f4adfb3296c4e8e7084bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:59:17.089933 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6faeb1-32dd-48a5-8081-ba36e36d9ff0 service neutron] REQUEST_METHOD: `GET` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:59:17.090209 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6faeb1-32dd-48a5-8081-ba36e36d9ff0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:59:17.090477 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6faeb1-32dd-48a5-8081-ba36e36d9ff0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:59:17.092158 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-5e6faeb1-32dd-48a5-8081-ba36e36d9ff0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:59:17.106458 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6faeb1-32dd-48a5-8081-ba36e36d9ff0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:59:17.107877 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6faeb1-32dd-48a5-8081-ba36e36d9ff0 service neutron] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:59:17.120253 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1459/2937] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 00:59:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 00:59:25.768933 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:59:25.772374 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:59:25.876394 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32dbb0-801d-4156-bbe0-30b7ffe694d6 service neutron] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:59:25.880896 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:59:25.881543 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:59:25.881823 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:59:25.882091 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] PATH_INFO: `/v3/users/b16db8c9b37f40faa002f48ddcc69847` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:59:25.883332 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b16db8c9b37f40faa002f48ddcc69847)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:59:25.885915 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:59:25.930787 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b16db8c9b37f40faa002f48ddcc69847'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:25.938030 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b16db8c9b37f40faa002f48ddcc69847'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:25.938632 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b16db8c9b37f40faa002f48ddcc69847'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:25.945563 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b16db8c9b37f40faa002f48ddcc69847'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:25.958794 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b16db8c9b37f40faa002f48ddcc69847'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:25.965442 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1479/2938] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:59:25 2022] DELETE /identity/v3/users/b16db8c9b37f40faa002f48ddcc69847 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:59:26.142690 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6faeb1-32dd-48a5-8081-ba36e36d9ff0 service neutron] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:59:26.154783 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6faeb1-32dd-48a5-8081-ba36e36d9ff0 service neutron] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:59:26.217638 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:59:26.218314 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:59:26.218624 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:59:26.218906 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] PATH_INFO: `/v3/projects/364e976131a741b7b7680a938f5ed70d` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:59:26.220182 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=364e976131a741b7b7680a938f5ed70d)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:59:26.222147 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:59:26.268984 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364e976131a741b7b7680a938f5ed70d', 'request_id': 'req-21bd197e-8629-4fe2-9530-94b01c149793'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.276201 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364e976131a741b7b7680a938f5ed70d', 'request_id': 'req-21bd197e-8629-4fe2-9530-94b01c149793'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.281773 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364e976131a741b7b7680a938f5ed70d', 'request_id': 'req-21bd197e-8629-4fe2-9530-94b01c149793'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.293141 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] The token cache is being invalidate because project 364e976131a741b7b7680a938f5ed70d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:59:26.293444 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.294086 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.295527 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1460/2939] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:59:26 2022] DELETE /identity/v3/projects/364e976131a741b7b7680a938f5ed70d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:59:26.299661 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:59:26.301162 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:59:26.314867 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da947e4a-662a-4753-9fa2-d0490ec865a3 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:59:26.335004 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:59:26.372347 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:59:26.372985 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:59:26.373264 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:59:26.373582 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] PATH_INFO: `/v3/users/3d15eaa485b947cc828fd5058ceab012` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:59:26.374702 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d15eaa485b947cc828fd5058ceab012)` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:59:26.376611 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:59:26.420554 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d15eaa485b947cc828fd5058ceab012'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.427918 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d15eaa485b947cc828fd5058ceab012'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.428671 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d15eaa485b947cc828fd5058ceab012'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.436859 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d15eaa485b947cc828fd5058ceab012'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.449014 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.notifications [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d15eaa485b947cc828fd5058ceab012'} {{(pid=87920) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.454813 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1480/2940] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 17 00:59:26 2022] DELETE /identity/v3/users/3d15eaa485b947cc828fd5058ceab012 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:59:26.626474 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] Authenticating user token {{(pid=87919) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 00:59:26.628013 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.fernet_utils [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87919) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 00:59:26.641088 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bd197e-8629-4fe2-9530-94b01c149793 admin admin] Validating token access rules against request {{(pid=87919) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 00:59:26.697582 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '50b388ebd083407da9c5b53df1e1692d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '83b1863d33eb4870a81458f19dc5d56c', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87919) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 00:59:26.698319 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 00:59:26.698600 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 00:59:26.698874 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] PATH_INFO: `/v3/projects/f1f606d769ef407a8c5ef1b6846e2e31` {{(pid=87919) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 00:59:26.699987 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1f606d769ef407a8c5ef1b6846e2e31)` {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 00:59:26.701942 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] RBAC: Authorization granted {{(pid=87919) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 00:59:26.708036 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:59:26.749669 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1f606d769ef407a8c5ef1b6846e2e31', 'request_id': 'req-176dc935-8a50-40f3-ab19-6a106fc99c38'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.756878 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1f606d769ef407a8c5ef1b6846e2e31', 'request_id': 'req-176dc935-8a50-40f3-ab19-6a106fc99c38'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.762407 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1f606d769ef407a8c5ef1b6846e2e31', 'request_id': 'req-176dc935-8a50-40f3-ab19-6a106fc99c38'} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.773268 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] The token cache is being invalidate because project f1f606d769ef407a8c5ef1b6846e2e31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87919) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 17 00:59:26.773590 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.775873 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG keystone.notifications [None req-176dc935-8a50-40f3-ab19-6a106fc99c38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87919) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 17 00:59:26.777385 dv-cinder-857528-4-smb devstack@keystone.service[87919]: [pid: 87919|app: 0|req: 1461/2941] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 17 00:59:26 2022] DELETE /identity/v3/projects/f1f606d769ef407a8c5ef1b6846e2e31 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 17 00:59:36.451405 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 00:59:36.770270 dv-cinder-857528-4-smb devstack@keystone.service[87919]: DEBUG dbcounter [-] [87919] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87919) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 17 01:01:50.811280 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] Authenticating user token {{(pid=87920) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 17 01:01:50.812684 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 01:01:50.882274 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543d2600-e14b-4e34-b5e0-d9968681ed37 admin admin] Validating token access rules against request {{(pid=87920) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 17 01:01:50.941387 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec604925-c452-47b6-9985-30d47961f06a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '47fef4612fbd4d00ad8de2a2144a2ba5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '51038cfbfdda4940b003287fce823318', 'project_domain_id': 'default', 'roles': ['service', 'member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87920) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 17 01:01:50.942021 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec604925-c452-47b6-9985-30d47961f06a service placement] REQUEST_METHOD: `GET` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 17 01:01:50.942302 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec604925-c452-47b6-9985-30d47961f06a service placement] SCRIPT_NAME: `/identity` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 17 01:01:50.942578 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec604925-c452-47b6-9985-30d47961f06a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87920) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 17 01:01:50.944319 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.fernet_utils [None req-ec604925-c452-47b6-9985-30d47961f06a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87920) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 17 01:01:50.955351 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec604925-c452-47b6-9985-30d47961f06a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 17 01:01:50.956923 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec604925-c452-47b6-9985-30d47961f06a service placement] RBAC: Authorization granted {{(pid=87920) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 17 01:01:50.967427 dv-cinder-857528-4-smb devstack@keystone.service[87920]: [pid: 87920|app: 0|req: 1481/2942] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 17 01:01:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 17 01:02:00.963212 dv-cinder-857528-4-smb devstack@keystone.service[87920]: DEBUG dbcounter [-] [87920] Writing DB stats keystone:SELECT=58 {{(pid=87920) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}